fossilesqueM to Science MemesEnglish · 1 year agoMagic πimagemessage-square69fedilinkarrow-up1733arrow-down17
arrow-up1726arrow-down1imageMagic πfossilesqueM to Science MemesEnglish · 1 year agomessage-square69fedilink
minus-squareAdkml [he/him]@hexbear.netlinkfedilinkEnglisharrow-up12arrow-down1·1 year ago“Only” using 15 digits is still pretty insane
minus-squareblind3rdeye@lemm.eelinkfedilinkEnglisharrow-up17·1 year agoYou get that level of precision in a standard “double” floating point number. So that’s basically the normal level of precision you get without trying.
minus-squareradiofreeval [any]@hexbear.netlinkfedilinkEnglisharrow-up9·1 year agoM_PI in math.h is like 20 digits. I’m surprised they just don’t do that.
minus-squareneptune@dmv.sociallinkfedilinkEnglisharrow-up4·1 year agoGoogle suggests that excel uses 15. So even college students working on any old STEM degree are probably using 15 digits.
“Only” using 15 digits is still pretty insane
You get that level of precision in a standard “
double” floating point number. So that’s basically the normal level of precision you get without trying.M_PIinmath.his like 20 digits. I’m surprised they just don’t do that.Google suggests that excel uses 15. So even college students working on any old STEM degree are probably using 15 digits.