When Altman celebrates lastly getting GPT to keep away from em dashes, he’s actually celebrating that OpenAI has tuned the newest model of GPT-5.1 (in all probability by means of reinforcement studying or fine-tuning) to weight customized directions extra closely in its chance calculations.
There’s an irony about management right here: Given the probabilistic nature of the difficulty, there’s no assure the difficulty will keep mounted. OpenAI constantly updates its fashions behind the scenes, even inside the similar model quantity, adjusting outputs based mostly on person suggestions and new coaching runs. Every replace arrives with completely different output traits that may undo earlier behavioral tuning, a phenomenon researchers name the “alignment tax.”
Exactly tuning a neural community’s conduct just isn’t but a precise science. Since all ideas encoded within the community are interconnected by values known as weights, adjusting one conduct can alter others in unintended methods. Repair em sprint overuse at present, and tomorrow’s replace (aimed toward bettering, say, coding capabilities) may inadvertently deliver them again, not as a result of OpenAI desires them there, however as a result of that’s the character of attempting to steer a statistical system with thousands and thousands of competing influences.
This will get to an implied query we talked about earlier. If controlling punctuation use remains to be a battle that may pop again up at any time, how far are we from AGI? We will’t know for positive, however it appears more and more probably that it gained’t emerge from a big language mannequin alone. That’s as a result of AGI, a expertise that may replicate human common studying capability, would probably require true understanding and self-reflective intentional motion, not statistical sample matching that generally aligns with directions in case you occur to get fortunate.
And talking of getting fortunate, some customers nonetheless aren’t having luck with controlling em sprint use outdoors of the “customized directions” function. Upon being informed in-chat to not use em dashes inside a chat, ChatGPT up to date a saved reminiscence and replied to 1 X person, “Received it—I’ll stick strictly to quick hyphens to any extent further.”
When Altman celebrates lastly getting GPT to keep away from em dashes, he’s actually celebrating that OpenAI has tuned the newest model of GPT-5.1 (in all probability by means of reinforcement studying or fine-tuning) to weight customized directions extra closely in its chance calculations.
There’s an irony about management right here: Given the probabilistic nature of the difficulty, there’s no assure the difficulty will keep mounted. OpenAI constantly updates its fashions behind the scenes, even inside the similar model quantity, adjusting outputs based mostly on person suggestions and new coaching runs. Every replace arrives with completely different output traits that may undo earlier behavioral tuning, a phenomenon researchers name the “alignment tax.”
Exactly tuning a neural community’s conduct just isn’t but a precise science. Since all ideas encoded within the community are interconnected by values known as weights, adjusting one conduct can alter others in unintended methods. Repair em sprint overuse at present, and tomorrow’s replace (aimed toward bettering, say, coding capabilities) may inadvertently deliver them again, not as a result of OpenAI desires them there, however as a result of that’s the character of attempting to steer a statistical system with thousands and thousands of competing influences.
This will get to an implied query we talked about earlier. If controlling punctuation use remains to be a battle that may pop again up at any time, how far are we from AGI? We will’t know for positive, however it appears more and more probably that it gained’t emerge from a big language mannequin alone. That’s as a result of AGI, a expertise that may replicate human common studying capability, would probably require true understanding and self-reflective intentional motion, not statistical sample matching that generally aligns with directions in case you occur to get fortunate.
And talking of getting fortunate, some customers nonetheless aren’t having luck with controlling em sprint use outdoors of the “customized directions” function. Upon being informed in-chat to not use em dashes inside a chat, ChatGPT up to date a saved reminiscence and replied to 1 X person, “Received it—I’ll stick strictly to quick hyphens to any extent further.”
