RSSAmplifier

Blog

helen qu

Recent content on helen qu

helenqu.comRSS feed ↗4 posts

Latest posts

Mechanism Design for AI Safety (Emergence Part 3)

In previous posts, we’ve seen how complex emergent behavior can arise in multi-agent systems , and how distributed cognition can emerge from environmental feedback . This led me to conclude that superintelligence is arguably more likely to emerge from a multi-agent system as opposed to in a single God-like superintelligent model, what I called the emergent superintelligence hypothesis .…

Regulation and the Emergent Superintelligence Hypothesis (Emergence Part 2)

In part 1 , we discussed the relationship between individual agent incentives, the environment, and emergent system-level phenomena. In this post we’ll conclude our discussion on emergence by understanding regulation , the process of negative feedback from the environment, which we’ll see is the key to the emergence of collective intelligence. This framing suggests that regulated…

An Emergence Perspective on Multi-Agent System Design (Part 1)

We observe emergent behavior in stunningly diverse parts of our world, ranging from collective animal behavior to economic systems. Emergence (as defined by Wikipedia ) “occurs when a complex entity has properties or behaviors that its parts do not have on their own, and emerge only when they interact in a wider whole”. In other words, emergent (or system-level) outcomes are more than…

RL's Deadly Triad Meets Optimization

\( \newcommand{\phit}{\phi_t} \newcommand{\phinext}{\phi_{t+1}} \newcommand{\enext}{\ebf_{s_{t+1}}} \newcommand{\et}{\ebf_{s_t}} \newcommand{\gradV}{\nabla_{\theta} V_{\theta}} \newcommand{\V}{V_{\theta}} \newcommand{\snext}{s_{t+1}} \newcommand{\tstar}{\theta^\star} \newcommand{\itmtx}{(\Ibf - \eta \Abf)} \newcommand{\AMC}{\Abf_{\text{MC}}} \newcommand{\Aon}{\Abf_{\text{on}}}…