RSSAmplifier

Blog

Yi's Blog

ycao.netRSS feed ↗16 posts

Latest posts

Building a Search Engine for 6,000 Personal Blogs

TL;DR: Semsearch is an embedding-based search engine whose corpus is bootstrapped from indieblog.page's blog list. It aims to make indie blogs more discoverable. Results are ranked by semantic relevance alone, without link popularity or SEO-derived signals. At the time of writing, the live instance is up at semsearch.blog with roughly 6,000 unique blog sites, 154k pages, and 1.4B tokens . The…

Math Education, and LLM

Abstract: This article defines math and math education, and argues for a lower bound of human effort required to learn mathematics (or any other abstraction-heavy subject) regardless of LLM capability. LLMs are evolving rapidly; within a year AIs are able to tackle math problems - we had thought of them as the hardest for AI to automate - but they are getting there. Let it be OpenAI's marketing…

三年LLM:过去和未来

OpenAI的ChatGPT于2022年年底发布。得益于境外手机号接码渠道,我第一时间就用上并惊叹于人工智能的突破。一转眼,LLM在过去的三年里已无可辩驳地渗透至千家万户。 一小段历史 Transformer模型最早于2017年由谷歌提出,核心思路是通过Self-Attention机制显式地表达词语之间语义联系 [1] 。OpenAI在2018年首次发布GPT-1模型,将架构简化为Decoder-only的Autoregressive词语预测 [2] 。自此,LLM的总体架构尘埃落定,后续的GPT-2、GPT-3等皆在此基础上扩展模型大小和数据集的规模。不仅局限于文字,Transformer在视觉领域表现也很好 [3] 。为何大模型能够 涌现 出强大的能力仍不得而知。Anthropic于2021年在一个极度简化的模型中发现了Induction Heads结构 [4]…

Color Recreation from First Principles

Abstract: This article provides a gentle derivation showing the existence of a simple, measurable linear relationship between the LMS color model as in human vision and RAW camera sensor data and the RGB values as in displays and jpg/png/etc. images. Real world colors are continuous spectra, such as the sunlight spectrum . We can describe it as a continuous function \(J(\lambda)\) where…

《死亡搁浅》玩后感及艺术评论思考

今日通关了《死亡搁浅》,不得不提,在游玩时我本以为这是后疫情作品在反思疫情隔离,没想到实际上游戏刚好于19年发售,真是巧合。 《死亡搁浅》最独到的地方,在于实现了作者表达、剧情和游戏性的统一。小岛秀夫的主要创作意图是体现人与人之间互帮互助的重要性,游戏的剧情便是Sam作为“送货人”将后末日世界中支离破碎的美国重新连接。创新点在于,游戏的核心玩法——送货——直接服务于这一主题。它无时无刻不在用“送货的艰辛”与“其他玩家留下的建筑所带来的帮助”形成鲜明对比,点赞系统也让玩家在帮助他人时获得反馈,大多数玩家都有类似的情感经验(举例 [1] )。 《死亡搁浅》的评价不出意料地出现分歧,主要集中在游戏性不强,玩法单一。 [2] [3] Sylvester在他的《游戏设计》中提出,游戏是“体验生成引擎” [4]…

《星际拓荒》玩后感

以下内容包含对Outer Wilds剧情的剧透。 Outer Wilds是一部以探索的方式,献给探索者的赞歌。 自伊始以来,人类祖先天然对远处充满好奇。对“那边”的好奇驱使我们走出非洲大陆,在地球上开枝散叶。Outer Wilds直指人类天然的好奇,游戏没有目标,只有开始天文台的些许指引,剩下的道路需要玩家顺着一个个未知现象自己走出。一开始,玩家急于知道面具是什么;然后地面上零零星星的遗迹吸引着玩家的兴趣;而Nomai文物上字里行间透出的零碎信息又将玩家带入更深的地方。“我发现了!”这一古老的欣喜不断驱动着玩家,给予各种不同的经历。 Outer…

Review on ASUS Zenbook S14 Laptop (LNL) with Linux

I am trying to pick a laptop that is as close to Macbook Mx Airs as possible - light, low power consumption and long battery life, with the only exception of not being an Apple device [1] [2] [3] - for the upcoming coursework. As for the chip itself, the closest I can get is Intel's Lunar Lake CPUs whose successor unfortunatelly Intel will not develop due to their management incompetentness .…

LLM will NEVER be AGI: The Proof

The proof is trivial with a little help of a necessary condition of complexity theories. All LLM runs under the complexity of \(O(n)\) , where \(n\) is the length of the output. Suppose LLM is AGI, then it is able to solve any problem that a human can solve. Consider the following problem: Given a string \(s\) of length \(n\) , determine whether \(s\) is a palindrome. Answer "Y" if it is and "N"…

On Programming Languages

While it is true that most of the time while developing software, we just pick either C++, Java, Python, etc. and start coding simply because A these languages are already well-established and have a lot of libraries and B we are already familiar with them. Yet new languages still emerge from time to time, such as Rust, TypeScript, and Julia, which are happily adopted (and hated) by developers.…

Simulating Gravitational Lensing

Ever wondered why the black hole in Interstellar looks like two rings intersecting each other orthogonally? It's because of the gravitational lensing effect . Physics behind this phenomenon comes from Einstein's general relativity and is quite complicated. (If you are interested, this Quora post has an in-depth walk-through.) However, There is an important clue that light travels in the same way…

Visiting NASA Goddard Space Flight Center

I have visited NASA Goddard Space Flight Center on August 1st, 2023. It's a great experience to see the real spacecrafts and the people behind them. What's more exciting is that photos are allowed in the visitor center, so I can share some of them here. Dustless Clean Room This is the dustless clean room where the spacecrafts are assembled. The air is filtered to remove dust and other particles.…

My 2023 Swift Student Challenge

Ah, Swift Student Challenge, the once in a year competition from our dearest Apple. From the very first moment I have decided to make some educational apps since I have seen an accepted submission which teaches the user about asymmetric cryptography. In fact, I had several inspirations on my list: Combine AR technology to show a 4D object projected onto a 3D space. Introduce signal processing from…

Kerbalhopper: PID explained with KSP

Introduction The Starship test flight by SpaceX is incredibly thrilling! True to your old habits, you've determined to recreate it in Kerbal Space Program. Perhaps it would be wise to begin by constructing a Starhopper replica. After all, you just need to take off and maintain your altitude for a few seconds, right? The rocket design is straightforward. All you need to do is affix a Dart engine…

An Introduction to Lambda Calculus

Introduction Who doesn't like simplicity! To me simplicity is not only a preference but a belief. I always has a werid feeling that only the simple things last. In the world of calculation, the most simple thing might be a Turing machine, a mathematical model of computation that is capable of implementing any algorithm using a tape, a head, a state and instructions. However besides the tape stuff,…

匀速圆周运动加速度的推导

人教版的物理必修二中跳过了对匀速圆周运动的向心力的推导,用 精确的实验表明,向心力的大小可以表示为...或... 这一套模糊的说辞蒙混过关了。这篇文章旨在帮助高中生理解公式的来历。 考虑一个物体在圆周上运动。我们记圆周运动的半径为 \(r\) ,线速率为 \(v\) ,角速度为 \(\omega\) , \(0\) 和 \(t\) 时刻的线速度为 \(\vec{v_{i}}\) 和 \(\vec{v_{j}}\) ,经过的角度为 \(\alpha\) ,易知 \(\lvert \vec{v_{i}} \rvert = \lvert \vec{v_{j}} \rvert = v\) ,且都与圆相切。 这一段时间中的平均加速度为 \[\vec{a} = \frac{\vec{v_{j}}-\vec{v_{i}}}{t}\] 当 \(t\rightarrow 0\) 时候 \(\vec{a}\)…

Invent wheels with Autotools & C

This how-to guide will teach you how to invent wheels with Autotools & C. Note that it isn't detailed, just to give you some ideas how the whole system works. Introduction Requirements My Autotools versions are: Automake 1.16.1 Autoconf 2.69 Libtool 2.4.6 And I'm on OS X. Installation guide will not be included. Product We'll make a simple C lib (C++ compatible) called libts helps you to get time…