The process of building/automating with LLMs still requries a lot of skill and experience. Whether you are using make, Wordware, writing prompts or coding LLMs yourself, you’ll end up passing variables, creating loops, aggregating values, concatenating strings, creating meta prompts, maybe writing your evals and you’ll definitely spend many hours testing. Only to remind yourself that LLMs are inherently non-deterministic, meaning, you might get an incorrect result 1 in 30 runs with the same input data. This is not a rant though. I believe this should be easier. Way easier. I mean way, way, way easier.
At the moment, the responsibility of taking the right direction, crafting the right prompts, coming up with good evals and thorough testing lies on the side of the User. If you fail, it’s probably a skill issue. I believe the ultimate path forward is where this responsibility switches sides.
I imagine Zapier, make, where I never touch any module, any aggregator, any filter and I am simply guided by the LLM, using built-in chat or perhaps directly from my own Slack. Evals? Sure, create hundreds of them and run them. Prompts? Please, make them bulletproof. Tests? Test it yourself and ask me to help you resolve edge-cases. Once we get to this place, I am pretty sure we are going to see explosion in personal software.
I also wonder about the shift in ownership. If LLMs take over these mundane tasks, how would be responsibility executed? Who is going to be responsible for things? Would people, organisations blame LLMs (other organisations)? Will this be reflected in new Terms and Conditions and pricing models? I don’t know. Perhaps the old way of doing things is sticky enough to stay with us for a while.
There are companies taking this direction already. Certain things got dramatically easier and models get better super-fast, almost on a weekly basis now. We are on a cusp of many breakthroughs and one of them is definitely making it » way « easier to build stuff.
There’s a huge opportunity in products which will abstract away everything you call “building” today and simply do it for you while chatting to you.
Join the discussion on LinkedIn ↗
