iOS 18.2 developer beta adds ChatGPT and image-generation features

cadence

Ars Scholae Palatinae
1,002
Subscriptor++
ChatGPT integration allows Siri to pass off user queries that are outside Siri's normal scope to be answered instead by OpenAI's ChatGPT.

Will this use ChatGPT's voice capabilities? Would love to hear how this integration works. I recently started using ChatGPT's native voice to talk to it while I'm biking. The problem is that when I use it like that, Siri won't work anymore, and cannot mute or pause the conversation without taking my phone out. It would be nice to have this seamlessly integrated with Siri.
 
Upvote
3 (12 / -9)

ninjonxb

Smack-Fu Master, in training
79
ChatGPT integration allows Siri to pass off user queries that are outside Siri's normal scope to be answered instead by OpenAI's ChatGPT. A ChatGPT account is required, but logging in with an existing account gives you access to premium models available as part of a ChatGPT subscription. If you're using these features without a ChatGPT account, OpenAI won't be able to retain your data or use it to train models. If you connect your ChatGPT account, though, then OpenAI's privacy policies will apply for ChatGPT queries instead of Apple's.

Based on the later part of this I assume this is meant to say "A ChatGPT account is not required" ?

Or did they make it so you do actually require an account?
 
Upvote
17 (17 / 0)
All the generative crap just leaves me cold. I would prefer to write and read for myself rather than turn it into yet another skill I outsource to a machine and ultimately degrade my ability to do myself (see also: navigating without GPS, remembering phone numbers). Things like this are "use it or lose it".

What I DO want AI to do is the rote, dumb shit. Let me tell my device: "find me a flight leaving LGA for Chicago O'Hare on the morning of November 9, returning in the evening of November 13, and find rental cars for that time" and have that actually work.
 
Upvote
33 (61 / -28)

aikouka

Ars Scholae Palatinae
1,195
Subscriptor
Genmoji and Image Playground are probably the two things that I'm looking forward to the most. Are they necessary? Absolutely not, but I'm sure I'll have fun generating random images to send to people. Sometimes, a GIF that you can find just doesn't fit what you want.

Also, I need to look into how to reorganize the list of options from the insert menu in Messages. Every time I try to insert an image, it's awkward that I have to go to the second page when it's probably my third most used one behind camera and photos.
 
Upvote
6 (15 / -9)
All the generative crap just leaves me cold. I would prefer to write and read for myself rather than turn it into yet another skill I outsource to a machine and ultimately degrade my ability to do myself (see also: navigating without GPS, remembering phone numbers). Things like this are "use it or lose it".

What I DO want AI to do is the rote, dumb shit. Let me tell my device: "find me a flight leaving LGA for Chicago O'Hare on the morning of November 9, returning in the evening of November 13, and find rental cars for that time" and have that actually work.


The irony is that I kinda want the opposite. Summarize the notifications and the emails, but let me do the stuff like booking flights because I'm picky about where I route through, how long my layovers are, etc.
 
Upvote
37 (41 / -4)
Post content hidden for low score. Show…

imchillyb

Ars Scholae Palatinae
677
Subscriptor
All the generative crap just leaves me cold. I would prefer to write and read for myself rather than turn it into yet another skill I outsource to a machine and ultimately degrade my ability to do myself (see also: navigating without GPS, remembering phone numbers). Things like this are "use it or lose it".

What I DO want AI to do is the rote, dumb shit. Let me tell my device: "find me a flight leaving LGA for Chicago O'Hare on the morning of November 9, returning in the evening of November 13, and find rental cars for that time" and have that actually work.
What you're asking for is an integration problem.

3rd party apps, programs, and systems would need to allow API calls to their proprietary software stack in order to allow this.

This is not an OpenAI problem, but a 3rd party -scared of other parties- problem.
 
Upvote
30 (31 / -1)

wrylachlan

Ars Legatus Legionis
14,871
Subscriptor
Initially, Apple Intelligence was planned to release as part of iOS 18, but some features slipped to iOS 18.1, others to iOS 18.2, and a few still to future undisclosed software updates.
Not sure where you’re getting this idea. From the first announcement Apple’s stated plan has been to roll out Apple Intelligence features across multiple point releases. I’m sure Apple would have loved for it all to be ready in time for 18.0 but that’s not what they announced.
 
Upvote
45 (47 / -2)

FinallyAnAccount

Ars Scholae Palatinae
1,459
Subscriptor
The irony is that I kinda want the opposite. Summarize the notifications and the emails, but let me do the stuff like booking flights because I'm picky about where I route through, how long my layovers are, etc.
If you could do something like "present me with a list of options, including routes and layover descriptions" it might significantly improve your analysis time, though. (Especially if, when you compared your own work, you couldn't find anything better/different.)
 
Upvote
12 (13 / -1)
If you could do something like "present me with a list of options, including routes and layover descriptions" it might significantly improve your analysis time, though. (Especially if, when you compared your own work, you couldn't find anything better/different.)
True enough. It could definitely be useful as long as I could refine according to my desires
 
Upvote
6 (7 / -1)

Jerion

Ars Centurion
304
Subscriptor
All the generative crap just leaves me cold. I would prefer to write and read for myself rather than turn it into yet another skill I outsource to a machine and ultimately degrade my ability to do myself (see also: navigating without GPS, remembering phone numbers). Things like this are "use it or lose it".

What I DO want AI to do is the rote, dumb shit. Let me tell my device: "find me a flight leaving LGA for Chicago O'Hare on the morning of November 9, returning in the evening of November 13, and find rental cars for that time" and have that actually work.
Same. I do not care for ML tools generating complex creative media or creating communications on my behalf. The skill that makes those things yours is the ability to start from an understood concept, begin creating something with some intent, revise your creation with amended intent, and then to understand and approve of your creation before conveying it out to the world. As true for a piece of music or painting as this paragraph.

ML tools should not exclude you from that process in any kind of real-world application. Summarize incoming messages for me perhaps; do not ever write my replies. Help me identify a travel plan within my budget with some basic criteria; don't book it for me. Help me decipher what a JS function is doing; don't invent one to replace it. ML can be a great asset for parsing information that would otherwise be mind-numbingly tedious to take in. Yet as soon as I lose the ability to understand what decisions I'm making, I am not going to be able to make them well.
 
Upvote
28 (29 / -1)

Fred Duck

Ars Tribunus Angusticlavius
7,166
Same. I do not care for ML tools generating complex creative media or creating communications on my behalf. The skill that makes those things yours is the ability to start from an understood concept, begin creating something with some intent, revise your creation with amended intent, and then to understand and approve of your creation before conveying it out to the world. As true for a piece of music or painting as this paragraph.

ML tools should not exclude you from that process in any kind of real-world application. Summarize incoming messages for me perhaps; do not ever write my replies. Help me identify a travel plan within my budget with some basic criteria; don't book it for me. Help me decipher what a JS function is doing; don't invent one to replace it. ML can be a great asset for parsing information that would otherwise be mind-numbingly tedious to take in. Yet as soon as I lose the ability to understand what decisions I'm making, I am not going to be able to make them well.
This is what is termed "progress."

Everything is about convenience.

How many people purchase ready-made clothing instead of tailoring or having them tailored? How many consumers purchase pre-packaged pasta sauces instead of simmering down tomatoes at home?

While you can still partake in such activities and feel proud that your bespoke production has your unique touch and speaks to your individual style, most people care not and will use the time saved to gorge on AI-generated YouTube influencer streams peddling the next Big Thing.

I say this as a trained fiction writer.


Have you seen the hit film Wall-E?
 
Upvote
5 (19 / -14)
The irony is that I kinda want the opposite. Summarize the notifications and the emails, but let me do the stuff like booking flights because I'm picky about where I route through, how long my layovers are, etc.
and the further irony is that both your requirements and those of @artvandelayIIII you were responding to were easily accomodated in the 1960s and 1970s by human travel agents. yes, that cost money (and created jobs...), but if you had a good travel agent, booking things was MUCH more efficient than the present day self-serve system.
 
Upvote
39 (41 / -2)

ArdentTotoro

Smack-Fu Master, in training
14
Initially, Apple Intelligence was planned to release as part of iOS 18, but some features slipped to iOS 18.1, others to iOS 18.2, and a few still to future undisclosed software updates.
I thought Apple was fairly clear at WWDC when they announced iOS 18 features, that several of the "Apple Intelligence" parts weren't slated for 18.0. This phrasing makes it seem like it's a delay, when it's really more "we had to announce AI features this year, otherwise Wall Street was going to pummel our stock."

Apple also seems to be taking their time and reducing their ambition to ever so slightly reduce the many harms of generative AI.
 
Upvote
24 (24 / 0)

cadence

Ars Scholae Palatinae
1,002
Subscriptor++
What you're asking for is an integration problem.

3rd party apps, programs, and systems would need to allow API calls to their proprietary software stack in order to allow this.

This is not an OpenAI problem, but a 3rd party -scared of other parties- problem.
Not necessary. See: Computer Use by Anthropic.
 
Upvote
2 (3 / -1)
Everything is about convenience.

How many people purchase ready-made clothing instead of tailoring or having them tailored?
I'm not sure that's about convenience. It'd be much more convenient to order the clothes I want and have them fit me, rather than have to spent time trying things on in multiple stores and ending up with something that isn't really what I wanted but more or less fits. A bigger barrier for most people will be the cost of custom tailored clothes — for example, $700-1500 for a custom tailored suit, vs $120 for something premade.

Anyway, I hope this iOS update fixes some of the bugs I've hit so far. QA really dropped the ball with 18.0, and macOS 15 too. I suspect management said "Tough luck, we have to release the new version in September, ready or not".
 
Upvote
-8 (1 / -9)

X-Dad

Smack-Fu Master, in training
79
Subscriptor
Also, I need to look into how to reorganize the list of options from the insert menu in Messages. Every time I try to insert an image, it's awkward that I have to go to the second page when it's probably my third most used one behind camera and photos.
a "Long press" on the + button will open your photo library

edit: or maybe you're trying to do something else?
 
Last edited:
Upvote
3 (3 / 0)
and the further irony is that both your requirements and those of @artvandelayIIII you were responding to were easily accomodated in the 1960s and 1970s by human travel agents. yes, that cost money (and created jobs...), but if you had a good travel agent, booking things was MUCH more efficient than the present day self-serve system.

well, yes and no. The problem is that a lot of the issues I have with certain routes are hard to describe in advance but when I see them I'm like "whoa, nope"

For example, I'll take a 30 minute layover on a United flight in Denver and feel reasonably confident that it'll be fine (depending on time of year anyway), but only if the flight before and after are less than about 5 total hours, otherwise I want a longer break just for comfort reasons.

If I'm flying southwest through Denver, on the other hand, I need to be able to account for a possible transfer between terminals so I always need a longer break there.
 
Upvote
-1 (1 / -2)
What you're asking for is an integration problem.

3rd party apps, programs, and systems would need to allow API calls to their proprietary software stack in order to allow this.

This is not an OpenAI problem, but a 3rd party -scared of other parties- problem.

Exactly. I am really only interested in automating useless drudgery out of my life. As a software developer I find the current batch of LLMs to be interesting technoloy, but the main use of those that I am interested in is using them in an Agent role where they mainly serve as a user-interface to other services that is easier to interact with as a human.

When it comes to creative-intelligence sources I prefer meat-space.
 
Upvote
13 (13 / 0)

Fred Duck

Ars Tribunus Angusticlavius
7,166
With this, can I finally reach emoji ligature nirvana? I want platypus-bears, turtle-ducks and wolf-bats! : D
When emoji first appeared, they were a pleasant, graphical way to express specific ideas.

The problem started when they became part of Unicode. Then everyone wanted to "improve" emoji. It wasn't enough to have a smile. We needed specific types of smiles. Then we needed customisable hairstyles, skin tones, and clothing for the emoji. Everything exploded and everyone wanted to depict everything.

Thus apart from very basic emoji, they're all incomprehensible.

This is the end-game, where GenAI will happily make anything and no one has any idea what it means.

A: Dude, that optometrist-on-a-pony emoji is sick.
B: IT'S AN OPHTHALMOLOGIST ON A HORSE! I'M BLOCKING YOU!

That said, I am interested in the turtle-ducks.

and the further irony is that both your requirements and those of @artvandelayIIII you were responding to were easily accomodated in the 1960s and 1970s by human travel agents. yes, that cost money (and created jobs...), but if you had a good travel agent, booking things was MUCH more efficient than the present day self-serve system.

Remember how in the 1910s, you'd send lists of desired goods to your grocer, who would select the items and ready them for you to purchase or deliver them to you? Then Piggly-Wiggly opened in 1916, introducing the strange "self-service" concept, which somehow took hold over the decades until the present age where now, we have Internet Grocery List Online Ordering (also termed "IGLOO") wherein you send lists of desired goods to your grocer, who will select the items and ready them for you to purchase or deliver them to you.

A bigger barrier for most people will be the cost of custom tailored clothes — for example, $700-1500 for a custom tailored suit, vs $120 for something premade.
This is both because the market is smaller and few people will wear one suit day in, day out.

https://www.ctda.com/blog/when-all-clothing-was-custom-18th-century-tailoring
Although even in the early 20th century, I believe tailored suits were still abundant.

https://blacklapel.com/thecompass/mens-suits-evolved/
 
Upvote
-2 (5 / -7)
Genmoji and Image Playground are probably the two things that I'm looking forward to the most. Are they necessary? Absolutely not, but I'm sure I'll have fun generating random images to send to people. Sometimes, a GIF that you can find just doesn't fit what you want.

Also, I need to look into how to reorganize the list of options from the insert menu in Messages. Every time I try to insert an image, it's awkward that I have to go to the second page when it's probably my third most used one behind camera and photos.
I am definitely not looking forward to receive images made by the new "creatives".
 
Upvote
-8 (3 / -11)

bizard

Wise, Aged Ars Veteran
114
Subscriptor++
What you're asking for is an integration problem.

3rd party apps, programs, and systems would need to allow API calls to their proprietary software stack in order to allow this.

This is not an OpenAI problem, but a 3rd party -scared of other parties- problem.
Apple could just tie the AI results to the accessibility features so that the agent could control menu items (in a user selectable subset of apps). One recent 'feature' I saw was the ability to tell me how to get to the multiply nested menu item and checkbox I needed to accomplish a task. If instead it just offered to turn that feature on for me, I wouldn't need to read it. Instead of me needing to try and follow directions on how to get Numbers to create a histogram, it could just do it.
 
Upvote
0 (0 / 0)

aikouka

Ars Scholae Palatinae
1,195
Subscriptor
a "Long press" on the + button will open your photo library

edit: or maybe you're trying to do something else?
It's a little confusing due to conflating terms, but I'm talking about the image/GIF search, which I think is listed as "#images". At least on my phone, it's near the top of the second page of options.

I am definitely not looking forward to receive images made by the new "creatives".
Oh, given all the "creative interpretations" for emojis today, I am quite sure that we'll see some... ahem... unique takes on emojis in the future. 😅
 
Upvote
1 (1 / 0)
I am definitely not looking forward to receive images made by the new "creatives".
Based on what they wanted to demonstrate during the keynote, the excellent things they felt deserved promotion and demonstration... I can't even imagine what the low end of the results will look like.

They're so awful that even if I bought into the optimism, they'd need several "yeah-but-it'll-get-better" cycles to get to the point they look like something Apple should find barely acceptable.
 
Upvote
-1 (2 / -3)
It's a little confusing due to conflating terms, but I'm talking about the image/GIF search, which I think is listed as "#images". At least on my phone, it's near the top of the second page of options.
When the list is up you can long hold and drag the items around to rearrange to get the useful things for you on the first page at the top.
 
Upvote
3 (3 / 0)

markgo

Ars Praefectus
3,779
Subscriptor++
If you could do something like "present me with a list of options, including routes and layover descriptions" it might significantly improve your analysis time, though. (Especially if, when you compared your own work, you couldn't find anything better/different.)
Congratulations, you’ve reinvented Expedia.

The reason there isn’t a “better” solution is that you generally can’t have the lowest fares on your preferred airline at your preferred times nonstop or connecting through your preferred airport.

The trade offs are not only highly individual, they are dependent on the trip itself.

It’s just not conducive to being solved “for” you, without an AI that knows everything about your life and what’s important to you.
 
Upvote
6 (6 / 0)
Not sure where you’re getting this idea. From the first announcement Apple’s stated plan has been to roll out Apple Intelligence features across multiple point releases. I’m sure Apple would have loved for it all to be ready in time for 18.0 but that’s not what they announced.
If I’m not mistaken it could be confusion around the fact that sometimes Apple refers to iOS 18 without specifying which point release, so when they say something like “coming to iOS 18” some people assume “18.0” instead of “18.X”.
 
Upvote
1 (3 / -2)

AntiqueTech

Seniorius Lurkius
3
Subscriptor

Also, I need to look into how to reorganize the list of options from the insert menu in Messages. Every time I try to insert an image, it's awkward that I have to go to the second page when it's probably my third most used one behind camera and photos.
That has bugged me as well and I finally figured out how to change it. It’s just like most list in iOS. Simply long press on the option you want to move and drag it where you want it.
 
Upvote
4 (4 / 0)

MyCatCanBeatYourDad

Smack-Fu Master, in training
63
I finally had an encounter with AI-based writing tools. I needed to generate summaries for chapters in a romance novel I'm writing (don't ask). Writers are notoriously bad at saying what their books are about, so it was worth a try.

Every last summary included the line "and they took their relationship to a higher level."

I guess it's true, but it's not useful and isn't going to entice a reader. I doubt I'll use the feature again.
 
Upvote
6 (7 / -1)
Not sure where you’re getting this idea. From the first announcement Apple’s stated plan has been to roll out Apple Intelligence features across multiple point releases. I’m sure Apple would have loved for it all to be ready in time for 18.0 but that’s not what they announced.

On Monday, Apple debuted "Apple Intelligence," a new suite of free AI-powered features for iOS 18, iPadOS 18, macOS Sequoia ...
Apple says that Apple Intelligence features will be widely available later this year and will be available as a beta test for developers this summer.

https://meincmagazine.com/information...-for-apple-intelligence-launched-at-wwdc-2024
 
Upvote
-6 (0 / -6)