Fieldwork

Enterprise AI design and delivery

The hardest part of enterprise AI is rarely proving that a model is capable—it is fitting a probabilistic model into a deterministic business workflow. At Zhipu AI, I led solution design and delivery for 40+ key enterprise clients, establishing controllable system boundaries. At ByteDance, I took over a stalled game content-moderation project and rebuilt explainable evaluation and mutually agreed acceptance criteria.

40+Zhipu AI · Key-account AI solutions designed and delivered
2 WeeksZhipu AI · From concept to working architecture & demo for an AI-NPC system
≈93%ByteDance · Accuracy on the aligned evaluation set for a stalled moderation project

Bounding generative behavior within system rules

Enterprise workflows demand predictability. At Zhipu AI, when designing an AI-NPC system for a gaming client, unbridled generation risked breaking character lore or game state logic. I decoupled the architecture into five modules: event triggers, behavior decisions, character dialogue, state maintenance, and exception handling. Shipped as a working demo in two weeks, this structure gave generative expression and deterministic system control clear boundaries.

Breaking acceptance deadlocks through shared criteria

At ByteDance, I took over a game content-moderation project that had stalled because our team tracked offline accuracy while the client worried about shifts in online detection rates across violation categories. I rebuilt the verification loop around stratified sampling, blind dual-annotation by both parties, structured disagreement resolution, and codified rules—combining a shared golden set with phased online rollouts to govern sign-off.

Outcomes and methodological reflections

After four iterations on this ByteDance moderation project, accuracy on the shared set reached ~93%, the client understood and accepted the attribution behind online rate shifts, and the project successfully closed with routine annotation handed over to the data team.

Method limits:Because this ByteDance moderation turnaround effort lacked a strictly locked holdout set, we relied on fresh online traffic to check generalization. While effective for aligning stakeholder trust and domain rules, it should not be mistaken for a textbook defense against benchmark overfitting.

Let’s talk

If you’re exploring an enterprise AI solution, working through an agent deployment problem, or looking for an AI product manager with LLM evaluation and delivery experience, get in touch about your scenario. I also welcome expert interviews and technical discussions in these areas.