Boyuan Chen

Boyuan Chen

Coding and AI are stepstones towards great products.

Build a link blog post

less than 1 minute read

Published:

Inspired by Simon Willison, I decided to put some links in my blog for helping myself to finish these links and useful resources, so that I can actually absort this.

Recently, my main focus is on training LLMs for coding/software engineering. Hence the following links might be very helpful:

  1. https://rlhfbook.com/
  2. https://github.com/therealoliver/Deepdive-llama3-from-scratch/
  3. https://huggingface.co/spaces/nanotron/ultrascale-playbook/
  4. https://huggingface.co/spaces/HuggingFaceFW/blogpost-fineweb-v1/
  5. https://github.com/Open-Reasoner-Zero/Open-Reasoner-Zero/blob/main/ORZ_paper.pdf/
  6. https://www.bilibili.com/video/BV1sd4y167NS/?spm_id_from=333.337.search-card.all.click&vd_source=30dd777f9dac71e1bdc7362c649969f6/
  7. https://docs.google.com/presentation/d/11KWCKUORnPpVMSY6vXgBeFSWo7fJcuGQ9yuR6vC1pzE/edit#slide=id.p/

These are mostly related to RL and Infra.

You May Also Enjoy

Thoughts on vibe coding

4 minute read

Published:

Recently, there’s a trend called “vibe coding,” proposed by Andrej Karpathy. It essentially means that by just telling what you want to build to LLMs, without writing a single line of code, everyone can build a standalone application. Many developers on X and Reddit are currently hyped about it, and I wanted to share my two cents.