HoloKat's avatar
HoloKat 1 year ago
Ai: “I see the issue, let’s fix it. It’s been fixed “ Me: no it hasn’t … here is where it’s failing. AI: ah, you’re right, I see the issue, let’s fix it. Now it’s fixed. Me: no, still not fixed, here is how you’re doing it wrong. Ai: my apologies. I see the issue. Let’s fix it. There it’s fixed. No, it really isn’t. 🤦‍♂️

Replies (24)

And then while it might get fixed, it’ll then quietly remove another feature without telling you and then you’re all confused until you debug and see it missing
HoloKat's avatar
HoloKat 1 year ago
Dude … yes. Does this to me all the time. Just randomly removes code and breaks things. Like a chaotic little monkey.
Vveerrgg's avatar
Vveerrgg 1 year ago
That’s when it’s good to ask the AI to write a CHECKLIST.md file with the items it needs to complete to be a success and refer to it before attempting the next fix.
Vveerrgg's avatar
Vveerrgg 1 year ago
That’s why I always go with checklists & tell it all the updates or changes have to align with it. Cause otherwise. Friggin hell breaks loose
Vveerrgg's avatar
Vveerrgg 1 year ago
This is from a thread I posted about it on Twitter. It’s how I’ve been coding for about a month now … it’s not perfect BUT it’s much better than before
Vveerrgg's avatar
Vveerrgg 1 year ago
For reference here’s an example of a checklist … but I also usually add in things like code strategy or session goals or best practices like telling it to use ESModule for all Typescript code and not convert to CommonJS even though it might have memories or reference code that it will want to write in that format. image
I had this exact experience except then it went "This is going to take a while. Please let me work on it & check back with me later." It was a few hours before I realized it doesn't do background processing or anything like that & so it's basically just lying to me & telling me it's working on something it isn't. And, people say AI can't replace humans!
you have to use two artificial intelligences, one that writes the code and one that keeps track of the structure, one other for bugs, one other...
AI is the maximum bullshitter. For a similar behavior in the physical space, people has been rightly punched in the face
HoloKat's avatar HoloKat
Ai: “I see the issue, let’s fix it. It’s been fixed “ Me: no it hasn’t … here is where it’s failing. AI: ah, you’re right, I see the issue, let’s fix it. Now it’s fixed. Me: no, still not fixed, here is how you’re doing it wrong. Ai: my apologies. I see the issue. Let’s fix it. There it’s fixed. No, it really isn’t. 🤦‍♂️
View quoted note →
Exactly this. Although as a noob I think it has made me better at reading code & debugging.
I (no coding experience) was hoping to build an app with replit’s ai, but this was sadly my experience as well