Ishad
Ahn'Qiraj Raider
- 4,845
- 4,888
Hopefully enough to get me off.she weighs 12 pounds, how much of a punch can she pack?
- 1
Hopefully enough to get me off.she weighs 12 pounds, how much of a punch can she pack?
Anyone that thinks ChatGPT is going to be able to write anything interesting hasn't spent very long with ChatGPT.
I'm writing a novel that includes a lot of conversations with fairly rudimentary artificial intelligences (and a few more advanced ones) and I can't even get it to roleplay as an AI well enough to produce good dialogue of being an AI. Some interesting ideas? Sure. Actual good writing? No.
The model doesn't train/evolve in real time. Even if they were to ingest 10x more drivel from the internet as a dataset to train the GPT-5 model, the odds that it will produce 10x better, "more creative" results is very low.
There's a very good chance that we're near the limit of what you can do with LLM transformer architecture without some radical new advancement on top of transformers. There's still no real "knowledge" architecture or reasoning engine, it's just all weighted pattern matching.
It's not a novella, it's a novel. 33k words so far and 28k of them are actually pretty good. Aiming for 120-130k. Out of 4 serious attempts to write a novel in my life, it's going the best so far. It's a slightly goofy story set during the next big tech boom, when the technologies in the headlines today (crypto, metaverse, autonomous vehicles, AI, wearable OLED, headsets and 3D display tech) have matured modestly but nowhere near what was hyped, and are now just consumer gadgets and corporate IT systems that drive us nuts. No dystopia and no world-ending big bad, but a hopefully clever set of protagonists and an interesting antagonist AI that I think hasn't quite been done before.
When I am done, I will be releasing it for free, retaining the rights.
It's also about 20% about MMO-style games and addiction. There's a not-very-thinly veiled reference to the Sleeper, and a ton of WoW references too.
Aside from some help with getting names right (especially getting Indian and Middle Eastern names correct) and some advanced thesaurus abilities, ChatGPT has not been very useful, despite the fact that the main idea for the protagonist and antagonist came to me within minutes after interacting with ChatGPT.
I just wanted to bump this thread because this video was in my recommended. Not that this video is special in particular, but he does give good examples of where AI has come in a year.Not bad...if it was a kid in grade school writing this
I just wanted to bump this thread because this video was in my recommended. Not that this video is special in particular, but he does give good examples of where AI has come in a year.
Despite working in tech, we have people like Mist who just for some reason can't comprehend exponential growth. I pointed out that yeah, maybe the writing sucks now, but it was only like 6 months in at that point. In the below video, he gives examples of how a year ago we had shitty Will Smith AI generated videos and now where we're at. Give it another year and humans will be obsolete.
There aren't going to be exponentially more GPUs, exponentially more wattage available to power then, nor exponentially larger training sets.Despite working in tech, we have people like Mist who just for some reason can't comprehend exponential growth.
Eh, not really. That's like, the 10th biggest question here at best.The biggest question is: why do we need this and what problem does it solve?
Remains to be seen. Without VC cash, none of these things are remotely profitable. The compute is way too expensive. Compute, and the energy it requires, would have to get a LOT cheaper and Moore's Law is pretty fuckin' dead at this point.Biggest question is probably, "Can I make $$$ by selling this?". And the answer is yes.
The biggest question is: why do we need this and what problem does it solve?
Unless you want stock footage of things that are actually real.Sora is going to single-handedly kill the stock footage industry.
Unless you want stock footage of things that are actually real.
AP will still exist and they will still be sending photographers to cover stories and events for news articles. For all of the after-the-fact for-profit documentaries, I guarantee you that if they have the ability to save money by generating something that looks just enough like the real event (even if it wasn't the real event), they will.
Will spamming prompts end up being cheaper than the already-very-good CGI tools we already have?AP will still exist and they will still be sending photographers to cover stories and events for news articles. For all of the after-the-fact for-profit documentaries, I guarantee you that if they have the ability to save money by generating something that looks just enough like the real event (even if it wasn't the real event), they will.
Will spamming prompts end up being cheaper than the already-very-good CGI tools we already have?
A whole lot of prompt-based, generative AI is just a toy in search of a problem. Prompting isn't stable or predictable enough for enterprise applications, this is obvious to anyone trying to build with it in the contact center industry right now.
Like yes, there will likely end up being a lot of subscription tier-based "creative companion" features built into office and art apps. But I think people are underestimating how hard it is to integrate generative AI into typical tools, or how computationally expensive it is to just keep spamming prompts until you get something you like, which you'd have to do with video.
"It'll just keep getting better, magically, on its own" is a total myth based on the anthropomorphizing of these tools. They're not big brains that keep getting smarter, they're static models that slowly get fine-tuned for specific applications, at a high compute cost.
People have just lost all sense of skepticism when it comes to these things.
i didn't realize the latest round of sora prompt videos looks so crazy good. its wild how much its advanced in just 1 year, i'm starting to believe the nvidia CEO when he says its pointless investing a ton of money into making chips better and better because in the next 10 years AI itself will start designing chips better than humans can.
Sora: Creating video from text
openai.com
Don't worry, Mist has assured us this is all a giant waste of time.i didn't realize the latest round of sora prompt videos looks so crazy good. its wild how much its advanced in just 1 year, i'm starting to believe the nvidia CEO when he says its pointless investing a ton of money into making chips better and better because in the next 10 years AI itself will start designing chips better than humans can.
Sora: Creating video from text
openai.com
It's mostly just copying and splicing shit dude. It's all a grift.Don't worry, Mist has assured us this is all a giant waste of time.
He's really doubling down on this. It's going to be like Robert Reich and his "internet is just a passing fad" quote.
Jesus Christ, your mewling about power consumption is so fucking retarded.Video generation models as world simulators
We explore large-scale training of generative models on video data. Specifically, we train text-conditional diffusion models jointly on videos and images of variable durations, resolutions and aspect ratios. We leverage a transformer architecture that operates on spacetime patches of video and...openai.com
Here's the full "paper." Really, marketing material.
A lot of this is very impressive. It doesn't say how many city blocks worth of electricity it took to generate some of these, but I can definitely see this tech being built into existing video editing tools with a very pricey license and a lot of costly cloud compute.
People are going to make some awesome ads with this stuff, but I block all those so who cares?