Senior Data Center Project Manager

Chamchagiri

Golden rule of chamchagiri : The closer you are to the boss's a*s, the faster you can smell your future success For the uninitiated - Newtons law of bootlicking or sycophancy- Every action of flattery has an equal and opposite reaction of promotion I get it - Chamchagiri is evil, it's corrupt, it's shallow, but bhai - it’s also VERY efficient. It gets you where you need to be. This way or That way. On the corporate ladder. Behind the boss's ......

Mapping the Mind of a Large Language Model

Just spent my entire evening diving into Anthropic's new paper "Scaling Monosemanticity" and wow - this is some groundbreaking stuff. Let me break down why I'm so excited: First, some background: These researchers basically managed to "decode" what's happening inside Claude 3 Sonnet (their mid-sized production model) using something called sparse autoencoders (SAEs). Instead of just seeing neurons firing randomly, they found millions of interpretable features that actually make sense to humans. The coolest findings: 1. They found features for EVERYTHING: - Individual features for specific people (like Einstein, Feynman) - Features that understand code bugs and security vulnerabilities - Features that recognize landmarks (like the Golden Gate Bridge) in both text AND images - Features that understand abstract concepts like "betrayal" or "internal conflict" 2. What blew my mind is that these features actually WORK: - They could make Claude believe correct code had bugs by activating the "code error" feature - They could make it write scam emails by activating the "scam" feature - They could make it act sycophantic by activating the "sycophancy" feature - They even found features related to how the model thinks about itself as an AI! 3. The scaling stuff is fascinating: - They used three different sizes: 1M, 4M, and 34M features - Found clear scaling laws (more compute = better features) - Showed that concept frequency in training data predicts whether a feature will exist But here's why this matters for AI safety (and why I'm kind of nervous): - They found features related to deception, power-seeking, and manipulation - Found features for dangerous knowledge (like making weapons) - Discovered features related to bias and discrimination - Uncovered how the model represents its own "AI identity" The limitations are important though: - This takes MASSIVE compute - They probably haven't found all the features yet - It's not clear if this will scale to even bigger models - There are still challenges with features being spread across layers Personal take: This feels like a huge step forward in actually understanding what's going on inside these models. Like, we're not just poking at a black box anymore - we can actually see the concepts the model is using! But it's also kind of scary to see just how much knowledge about potentially dangerous stuff is encoded in there. TLDR: Anthropic managed to extract millions of interpretable features from Claude 3 Sonnet using sparse autoencoders. Found features for everything from code bugs to deception to self-representation. Both exciting and scary implications for AI safety. https://transformer-circuits.pub/2024/scaling-monosemanticity/index.html

All is not well at Paytm Money

A subsidiary of Paytm, it has been hit by a string of exits in Senior leadership in last 6 months CFO: Amit Kapoor, gone Head of Mutual Funds: Nisharg Golash, gone Head of Product: Manish Reddy, gone Head of Growth: Sourav Choraria, gone Head of Marketing: Divya Chakravarthy, moved internally Head of Compliance: Sudhendoo Gandhi, moved internally You can search these people on LinkedIn to verify. This is a result of an increasingly toxic work culture where performers are penalized with more work while slackers make merry. This culture is driven from the top with current senior leadership who haven't left the firm have survived by the virtue of sycophancy. Instead of firing people, they are being asked to resign so that the company is not in news. I've personally seen this in co's rev teams, a new CTO has been hired from within Paytm. Employees are given 'negative ratings' in appraisal, which the CEO called 'an HR experiment'.