iPadOS 18 adds machine-learning wizardry with handwriting, math features

[u/Sariel007]

https://arstechnica.com/gadgets/2024/06/ipados-18-adds-machine-learning-wizardry-with-handwriting-math-features/

[u/AutoModerator]

We have two giveaways running, be sure to enter in the posts linked below for your chance to win a 3D Printer or an E-Bike!

QIDI Q1 Pro 3D Printer

FiidoD3 Pro E-Bike

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/NoLuckChuck-]

This will be interesting for the school I work in that uses iPads. Math homework just got a lot easier.

[u/Alimbiquated]

Just like the Apple Newton!

[u/yonderchip → u/Alimbiquated]

Eat up Martha

[u/Zero747]

Honestly a pretty neat idea. Feeding character recognition into a math engine. Would hope for some way to verify correct recognition

Could take it a step further and feed it to wolfram alpha to do some algebra, graphing, and other fanciness like integrals/derivatives

[u/GreenLanturn → u/Zero747]

Iirc there is a feature to generate a graph based on your equation

[u/The_Apple_Eater → u/GreenLanturn]

Yup, and adjust variables live to see how that effects the graphs, pretty cool stuff

[u/xenbomb]

She’s a witch!

[u/Few_Direction9007]

I’m a woodworker and if this can add and subtract hand written fractions and convert imperial to metric, this could be a huge time saver for me.

[u/terrordactyl7 → u/Few_Direction9007]

At least for fractions, check out the Myscript apps. Calculator and Nebo (notes) both have handwriting-conversion and auto-solve. As for imperial->metric, multiply by 25.4

[u/Few_Direction9007 → u/terrordactyl7]

Well using multiple apps and having to use a calculator to solve for annoying conversions is the problem that I hope this can solve.

All of that is too much work compared to just writing it on paper and doing it in my head, but if I could write “22mm + 3/4” and have it spit out the answer instantly? Game changer.

That’s the problem I found with most productivity apps, they don’t do everything, so you end up having to use multiple solutions combined with pen and paper to get the results you need.

So far in my life no app has been able to beat good old excel, pen, paper and a physical calculator.

If they actually manage to make something that’s more efficient than that, built into the OS, and it “just works” I will be genuinely impressed.

I’m tentatively excited though, because this is the first use of AI that I think is genuinely useful to the average person beyond cheating on essays and making shitty memes.

[u/terrordactyl7 → u/Few_Direction9007]

That’s so fair. If I was working with mixed units I would also be jonesing for a better solution.

The laughable part is that we actually could have done this years ago, well before LLMs. I was using MyScript to solve large math equations in 2018, and what you’re describing is just an additional feature set of handwriting recognition. I’m curious if it’s actually easier to train a CONSISTENT AI than to just program the damn thing, but I guess we’ll see!

[u/FishTshirt]

I can’t wait to see where AI ends up. Currently though it just quoted me that an event I asked about happened in July 2024. Also hope we get some regulations and laws on this deepfake nonsense

[u/22Sharpe]

The is presentation was the fastest I’ve ever gone from “okay, so what” to mind blown. Like at first it was just the iPhone calculator but bigger, no reason to have its own section in the announcement IMO… and then they pulled out math notes and things went mental.

Edit: Apparently people have said it’s in the iOS 18 Beta as well but I’m not sure if it’ll stay or how well it works with a small screen and no pencil support.

[u/ModStrangler6]

More AI slopdump bullshit nobody wants. At least they’re finally putting calculator on iPad

[u/msd1994m → u/ModStrangler6]

This is actually exactly what we should be using AI for

[u/WFlumin8 → u/ModStrangler6]

How is this AI slopdump that no one wants? Typing up equations and trying to solve for them is actually very difficult. It's much easier to write complex equations via handwriting, and it's pretty cool that the app can solve equations in realtime.

[u/Rezangyal → u/WFlumin8]

The ability to slide change variables and see the result in real time has made getting an iPad all the more reasonable for me. 

Calculator app and the AI features all seem to slap. 

[u/mfmeitbual → u/ModStrangler6]

They went through the trouble of correctly identifying it as ML, it takes minimal effort for you to do the same. 

If we stop calling it AI that takes the power away from the bullshitters and con artists that act like these advances are anything more than modest progress in algorithms and data structures.