~www_lesswrong_com | Bookmarks (664)

Published on October 26, 2024 12:37 PM GMT"Close the darn window! You know it gives me the creeps," Doctor Myrkina hissed, glaring angrily at the daylight streaming in through the open curtains."Sunlight is good for you," Captain Tralith insisted, pulling the curtains open wider.  She smiled in a vaguely threatening way as she did so, showing off far too many teeth.  "I never understood...

Published on October 26, 2024 12:34 PM GMTThe Summoned Heroine and the Demon KingThe Summoned Heroine announced to the Circular Citadel that she would be creating a prediction market, to help them anticipate and counter the Demon King’s next moves. There was cheering, on general principles.The Demon King donned a mortal guise, bought shares in “The Demon King will attack the Frozen Fortress”, and...

Published on October 26, 2024 11:08 AM GMTWe are pleased to announce that the 10th version of the AI Safety Camp is now entering the team member application phase!AI Safety Camp is a 3-month long online research program from January to April 2025, where participants form teams to work on pre-selected projects.We have a wide range of projects this year again, so check them...

Published on October 26, 2024 9:42 AM GMTLessWrong user dynomight explains how arithmetic is an underrated world-modeling technology and uses dimensional algebra as the motivating case. I agree dimensional algebra is fantastic, but there’s an even better motivating example for arithmetic in world-modeling: linear models for prediction.Simple linear models outperform expertsIn 1954, Paul Meehl published what he later came to call my disturbing little...

Published on October 26, 2024 2:30 AM GMT When I was growing up most families in our neighborhood had the daily paper on their lawn. As getting your news on the internet became a better option for most folks, though, delivery became less efficient: fewer houses on the same route. Prices went up, more people cancelled, and decline continued. I wonder if we might...

Published on October 25, 2024 11:20 PM GMTThe following is born out of a frustration with the free will, determinism and compatibilism debate and its terminology—finding my intuitions do not seem to align with a particular camp. This is an attempt to explain my philosophical position in a way that provides a basis to reconcile that which is subjectively important (to me at least)...

Published on October 25, 2024 7:37 PM GMTTL;DRI spent a few hours going through Open Philanthropy (OP)'s grant database. The main findings were:Open Philanthropy has made $28 million grants for Technical AI Safety (TAIS) in 202468% of these are focused on evaluations / benchmarking. The rest is split between interpretability, robustness, value alignment, forecasting, field building and other approaches.OP funding for TAIS has fallen...

Published on October 25, 2024 6:00 PM GMTWhat labs should doThe table/list in Towards best practices in AGI safety and governance: A survey of expert opinion (GovAI: Schuett et al. 2023): a collection of many briefly-described safety practicesResponsible Scaling Policies and Key Components of an RSP (METR 2023)Model evals for dangerous capabilities (Stein-Perlman 2024): just the summarySafety cases (arguments that an AI system is safe to...

Published on October 24, 2024 9:08 PM GMTSentience is the capacity to experience anything – the fact that when your brain is thinking or processing visual information, you actually feel what it’s like to think and to see.The following thought experiment demonstrates, step by step, why conscious experience must be a product of functional patterns, not any specific physical material or structure.The Inevitable Self-Report...

Published on October 25, 2024 11:06 AM GMTThe EU and UK's Network and Information Systems (NIS) Regulations aim to improve the cybersecurity of essential services and important digital providers. They set requirements around network security, information system security, physical security, incident handling, business continuity and security auditing.I think OpenAI needs to comply with these regulations. This article sets out why, and what the implications...

Published on October 25, 2024 4:37 AM GMT Memorandum on Advancing the United States’ Leadership in Artificial Intelligence; Harnessing Artificial Intelligence to Fulfill National Security Objectives; and Fostering the Safety, Security, and Trustworthiness of Artificial Intelligence This memorandum fulfills the directive set forth in subsection 4.8 of Executive Order 14110 of October 30, 2023 (Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence)....

Published on October 24, 2024 11:10 PM GMTI am often tempted to give advice, and find it difficult to say nothing while friends and colleagues make decisions that seem (to me) obviously wrong.But advice is by nature bad, and it is not hard to see why. We are different people living under different circumstances. Giving advice is not only unhelpful, it is often harmful....

Published on October 25, 2024 12:10 AM GMT A few weeks ago I posted about how I was thinking about a pedalboard. I've now made one! Before: After: It folds up slightly and fits in a standard rolly suitcase: Not pictured: I later added padding on all six sides. Here's the pedalboard by itself: You can see the bundle of wires to the left...

Published on October 24, 2024 8:50 PM GMTHuman capital trades more like real estate than equities. While millions in S&P 500 stocks can exchange hands with a single click, hiring employees or finding life partners always requires a final offline, high-touch evaluation - much like inspecting a house before closing the deal.In the job market, some predictive attributes can be translated into text -...

Published on October 24, 2024 6:36 PM GMT[Linkpost. This presents a way to talk to people about AI that hold overly-romanticized views built on fictional evidence.]MRSA (Methicillin-resistant Staphylococcus aureus) is a type of staph bacteria that’s become resistant to many of the antibiotics we use. The original staph bacteria that is the ancestor of MRSA was first identified in 1880, but has likely existed...

Published on October 23, 2024 6:10 PM GMTWe are launching an independent research lab that builds open, scalable technology for understanding AI systems and steering them in the public interest.Transluce means to shine light through something to reveal its structure. Today’s complex AI systems are difficult to understand—not even experts can reliably predict their behavior once deployed. At the same time, AI is being...

Published on October 23, 2024 3:50 PM GMTThis post includes a "flattened version" of an interactive diagram that cannot be displayed on this site. I recommend reading the original version of the post with the interactive diagram, which can be found here. Over the last few months, ARC has released a number of pieces of research. While some of these can be independently motivated,...

Published on October 23, 2024 2:31 PM GMTAI is a very controversial topic these days, but I can't help but ask, what's the deal with OI[1], does it have any powerful effects on the future, and can it compete with AI?^Organoid Intelligence is, I quote "an emerging multidisciplinary field working to develop biological computing using 3D cultures of human brain cells (brain organoids) and...

Published on October 23, 2024 12:18 PM GMTTwo important themes in many discussions of the future of AI are:AI will automate research, and thus accelerate technological progressThere are serious risks from misaligned AI systems (that justify serious investments in safety)How do these two themes interact? Especially: how should we expect the safety tax requirements to play out as progress accelerates and we see an...

Published on October 23, 2024 6:01 AM GMTHey LessWrong,After sharing early results at Less Online this summer (thanks for the feedback during the strength training demos), I'm recruiting for a LessWrong team in the 2025 Unaging System Challenge. What started as helping one friend who got winded climbing stairs has grown into a complete system that could add two decades to our lives. The...