Why do computers suck at math?

10 Views
Published
What is a floating point number? And why does it produce rounding errors for programmers?

#shorts #compsci #math

Learn something? Keep the content flowing https://github.com/sponsors/codediodeio

Resources:

https://engineering.fb.com/2018/11/08/ai-research/floating-point-math/
https://0.30000000000000004.com/
https://floating-point-gui.de/formats/fp/
Category
Fireship
Tags
math, compsci, floating point
Be the first to comment