惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

L
LangChain Blog
C
Check Point Blog
月光博客
月光博客
Y
Y Combinator Blog
I
InfoQ
B
Blog RSS Feed
P
Proofpoint News Feed
腾讯CDC
博客园 - Franky
MyScale Blog
MyScale Blog
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
V
V2EX
Hugging Face - Blog
Hugging Face - Blog
V
Visual Studio Blog
H
Hackread – Cybersecurity News, Data Breaches, AI and More
云风的 BLOG
云风的 BLOG
罗磊的独立博客
B
Blog
人人都是产品经理
人人都是产品经理
Engineering at Meta
Engineering at Meta
MongoDB | Blog
MongoDB | Blog
Recent Announcements
Recent Announcements
美团技术团队
大猫的无限游戏
大猫的无限游戏

Benson's blog

Enjoy life Internship AI on academic research How AI Will Change the Mobile Ecosystem Look ahead Goodbye 2025 Hacker News to Kindle Another project How to imporve english Introduction of Fraud detection PopTranslate Last day in netease Better idea between Copilot-typed and CLI-typed assistant Gemini-cli LLM Post-Training experience Papers I readed recently about LLM application Difference between LLMs and traditional computer technology GRPO Weekly-#26 AI Application Weekly-#25 AI infra and application Weekly-#24 First week as LLM inference engineer Weekly-#23 seeking job Weekly-#22 2025 New Year Goodbye 2024 Weekly-#20 Breaking of glass Cross Entropy Loss of Triton Weekly-#18 Cross Entropy Loss of Triton Weekly-#17 Triton Puzzles Weekly-#16 AutoBuilder Weekly-#15 Starting of tanble tennis
AutoSwitch Translate
Benson · 2025-01-18 · via Benson's blog

Product

AutoSwitch Translate

Final make this extension, which can automatically switch target language when source language is same with target language.

What surprised me was I only spen half day to program and build this extension, which inspired to do it immediately after have a new idea, this will be the best experience not only for result but also for my satisfaction.

This can save lots of time when using Goole Translate. In addition, I can totally transfer from baidufanyi to Google Translate.

PopTranslate

Found the API used in Google Translate extension and use it in my extension, maybe it’s not a nice behavior.

It works well in for five days, hope it works for a long time.

Triton

I want to do more about Triton, here is all what I can think

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
* rewrite or improve current kernel
    * flash attention
    * cut cross entropy 
    * CE
* analysis time and memory cost of kernel 
    * compare different model and framework [H]
        * Unsloth 
        * Deepseed
        * TensorRT-LLM
        * vLLM
        * Liger-Kernel 
        * Flash-attention 
        * xformers
        * DeepSeek
            * MoE
            * electricity 
            * MLA
            * MTP
            * fp8
    * dimensions
        * fine-tune 
        * inference 
    * improve and test 
* architecture ability
    * cuda 
    * llama.cpp

As a result, I will try Pytroch profiler at first, there will be more thing in it I can do.

In addition, Found a good post about matrix multiplication, try to do it by Triton.

English

  • Podcast: Do not weel, I need more patience.
  • Read and comment: as above.
  • Books: Read more on first language

Summary

1) Do it as soon as possible after having a new idea.

2) I always travel in a loop between hope and disappointment, maybe this is the life.

This week

  • Triton
  • Update PopTranslate
  • Google translate extension
  • English
  • Exercise

Next week

  • Triton
  • English
  • Reading

This post is licensed under CC BY 4.0 by the author.