Activity
Mon
Wed
Fri
Sun
Sep
Oct
Nov
Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
What is this?
Less
More
The RoboNuggets Network (free)

70.5k members • Free

Clief Notes

46.2k members • Free

Brendan's AI Community

26.7k members • Free

Wavi's AI Studio Academy

819 members • $997

Vertical AI Builders

10.2k members • Free

AI Automation Society

441.4k members • Free

AI Automation Agency Owners

3.4k members • Free

13 contributions to Clief Notes
Dual View Architecture - Full Orchestration Engine.
Here is a failure mode that ships more often than it should. The model that writes an output is also the model that checks it. You send the result back with "review this and flag anything weak," and the review skews toward approval, because a model reviewing its own work shares its own blind spots. This is a documented limitation, not a hypothesis. It is not universal. Plenty of teams already run multi-step pipelines, separate critic models, and output validators. But self-review as the only quality gate is still common, and for enterprise-grade output, where a confident wrong answer is a liability, it is worth solving properly. This post is how we approached it, where the design is genuinely sound, and where it is not. I want this community to review both. Why self-review is weak Two things work against a single model checking itself. The first is autoregressive momentum. A model picks each word partly from the words it already wrote, so the opening of an output conditions everything after it. A model that has generated thousands of reports has a strong format prior: summary, background, analysis, recommendation. Your spec might say to lead with the competitive threat and drop the background. That instruction competes with the prior, and a few sentences in, the prior often wins. The output looks like a report. It is not your report. The second is that evaluation has a prior too. In training data, reviews of polished work skew positive, so a model asked to "evaluate this" leans toward approval. A reviewer that is the same model, or the same model family, shares the writer's biases. Here is the honest version of the claim, and it is less dramatic than how this is usually sold. Prompting is not powerless, it is unreliable as your only quality control. Self-critique does catch real errors. It just catches fewer than an independent reviewer would, and you cannot tell from the output which case you got. So you do not throw prompting away. You add structure around it.
2 likes • May 21
I’ve done a lot of experimentation on this and I honestly do not think true autonomous self-review is possible unless you train an open source frontier sized model on your data All frontier llm models are trained for general use, no matter how many different models you call or how well your write the evals or how well you define what you want, these are just directional layers on top of a general use llm model, it won’t be able to 100% mimic your thought process, eval process, or decision making process because your decision making matrix that’s tied to all the data that’s in your head and how that data is connected isn’t baked into the llm model You can use Ai to speed run 85% of the underlying base of self review(development, eval creation, eval testing, etc.) but you still need to human in the loop for the last 15% actually reading through and deciding which evals to use, what eval results are acceptable, where to adjust the eval results Honestly karpathy’s autoresearch paired with codex as an adversarial outside reviewer tweaked to your use case will get you that base 85% in a couple days In other words Ai can only replace or reduce the number of interns or entry level employees that sort, sift, and organize raw data at an astronomically higher speed and quality
I stopped running everything on Opus. Here's the system I built instead.
Running Claude Code on Opus is powerful. But most turns in a session are mechanical, reading files, writing boilerplate, simple edits. You're paying top-tier rates for work that Haiku could handle in its sleep. Anthropic just released the Advisor Tool: A server-side pattern where a cheap executor model consults Opus mid-generation for strategic guidance. But it's API-only. Can't use it inside Claude Code. So I rebuilt the pattern inside Claude Code using what already exists. The setup: Opus stays in the orchestrator seat. It plans. It makes architecture decisions. It reviews output. It never touches files directly unless the task genuinely needs Opus-level judgment. Everything else gets dispatched to cheaper models: - Agent({ model: "haiku" }) — Claude subagents with full file access for simple edits - Agent({ model: "sonnet" }) — for multi-file changes that need moderate reasoning - A CLI tool (ask.py) that routes to Gemini, Kimi, MiniMax, or local Gemma via Ollama — for code generation, research, video analysis, anything where you just need text back The routing logic: Does the task need file access? → Agent tool (haiku/sonnet) Is the code complex? → sonnet or gemini Is the code simple? → haiku, kimi, or minimax (cheaper) Need video analysis? → gemini --video (native, no frame extraction) Need parallel research? → kimi-swarm (spawns up to 100 sub-agents) Want zero API cost? → gemma running locally via Ollama When a subagent hits something it can't handle, it reports back NEEDS_GUIDANCE. Opus thinks it through and re-dispatches with better context. That's the advisor pattern, strategic guidance exactly when needed, cheap execution everywhere else. Cost impact: A 10-task session where 8 tasks go to Haiku and 2 to Sonnet — your Opus tokens are only spent on planning and review. Maybe 20% of the total token volume. The other 80% runs at Haiku rates. With local models mixed in, it drops further. Open-sourced the whole thing:
1 like • Apr 11
have you tested gemma for for haiku and sonnet while keeping opus in driver seat? does it test out well?
When Claude Code gets dumbed down, hard gate Folder Architecture don’t use open source models
Has anyone else noticed Claude was actually really unintelligent this week after mythos preview was announced? thank god for Clief’s Folder Architecture, all I had to do was hard gate into global Claude config and Claude become intelligent enough to use again PSA: don’t use open sourced models for coding + reasoning, no matter how good they are on benchmarks if you plug it into Claude code it will never be as good as Claude code, just take a couple days break Open sourced models can do task execution well but other than that honestly don’t waste your budget
0 likes • Apr 10
@Mark Gubuan Claude announced a new advisor feature I think can replace openclaw if you pair it with scheduler command, cowork burns too may tokens if you give it multi-tool tasks but if it’s one tool like search through gmail and then create a excel report or any report it does that pretty cheaply and reliably per my experience, might have to figure a way out to control it all from one chat like openclaw but using desktop app I think is a ok patch for now cause you can use Claude code in desktop app as well
0 likes • Apr 10
@David C yeah I tried this before as well but I got burned multiple times before because every time a new frontier llm comes out all the routing all the experimenting i did became obsolete because the new model could do it in one shot 🥹 and all the other open source would come out with better model then I had to redo everything again 🥹
New Features in Claude Code
Is everyone caught up with all the new claude code features? so many new features i don't know what new capabilities i should start learning 🥲
1 like • Mar 28
@Neil Napier i honestly don't trust claude enough for it to give me a honest answer especially in regards to their new features, not in a bad way because i understand if i'm using claude, claude wants to keep me in its ecosystem you can test it out by talking to different llm's, its very subtle but its there
1 like • Mar 28
@Roger Roland true agi? 😦😦😦
Obsidian Vault = Persistent Memory
Has anyone tried to apply the folder structure learned here into their obsidian vault? Clief folder architecture really helped with retrieval and how knowledge is linked, this new meta really documents my current understanding on various subjects very well, in claude code sessions i don't have to explain as much context as before because claude code "knows" what i mean even better because of obsidian vault, but i realized that there needs to be a naming convention that works with clief folder architecture to make it truly optimized Anyone have any suggestions as to how to set up the naming convention?
0 likes • Mar 28
@Michael Roach-Duquette agreed, but i would argue that what you have brainstormed is only suitable for non-coding information obsidian as a second brain to claude code is to allow coders to not have to remember everything in their head that was learned or done in coding sessions but gets applied in future coding sessions if that something learned or done gets re-used so you don't have to waste time experimenting and trying things you already did once before ie. gemini embedding 2 api is not optimized for helping with RAG and embedding retrieval it often drops or takes too long, could be due to high-volume usage because its an api or their embeddings 2 is only suited for creating embeddings and not retrieval
1 like • Mar 28
@Alex Shaddy hey man, thanks a million, i just realized how over-engineered my original my approach was
1-10 of 13
Alex Kao
3
22 points to level up
@alex-kao-3961
learning make automations

Active 15d ago
Joined Mar 15, 2026
Powered by