-
Notifications
You must be signed in to change notification settings - Fork 10
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix accumulator and result types #14
Conversation
operand_element_type = config.operand_element_type | ||
acc_element_type = config.accumulator_element_type | ||
result_element_type = config.result_element_type | ||
assert not operand_element_type.startswith('i'), "Integer types not supported yet" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
What's the reason integer types not supported? (would it not just work with this i8 operand, i32 accumulator, i8 result type?)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Well they are not supported elsewhere either -- I didn't want to plumb through int8 support in the same PR
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks
For example, perform f16 matmul with f32 as the accumulator type and truncate the result to f16. This is more realistic than using f16 as the accumulator type.
Keep track of operand, accumulator, and result types in
GemmConfig
.