Sean Hwang

I always aim to raise topics and questions relevant to startups/products and my personal endeavors that others might relate to.

The threads usually start with an intro to the topic, my experience, and, lastly, ask others to share their experiences. I try to structure these parts into clear, error-free sections so that they are easy to read. I have never used AI, for what it's worth.

As a developer, I'm always keen to learn about the toughest technical challenges that startups face when building their products.

I'm actually facing one right now
A product that I'm building involves the use of computer use models to automate desktops, so its accuracy is tied to the accuracy of the models that are available. As of few days ago, the best model (OpenAI CUA o3) achieves a score of 42.9 according to OSWorld benchmark, which means it successfully completed 42.9% of the 369 tasks it was assigned. It's not great, obviously has a ton of room for improvement. The good news is, technology is advancing at such a rapid pace that in short time, we'll see models that will far surpass the current capabilities. It's exciting!
Your turn - what is the toughest technical challenge you've faced?

The industry is advancing and changing at a rate we've never seen before, and it's only going to continue accelerating.

We're at a time where we must continue to educate ourselves with new technologies or risk falling behind for good, especially as creators.