Explore tweets tagged as #transcoder
System design addresses how different parts of a system communicate, manage data, & handle requests. And this course teaches you the key concepts by building a YouTube clone. Along the way you'll incorporate 3 key services: upload, watch, & transcoder.
4
139
860
Still working on a transcoder solution for the original Rapture TV digital files. Oh the joy. @rapturetv #RaptureTVonYouTube
0
0
0
building an av trimmer/transcoder is on the path to the video composed (all in browser, cause otherwise.. lol?) + permissions sidequest speedrun any %; there's a simple locking mechanism on assets/files
1
0
1
I love it when a plan... Falls apart. 🤣 #CLIP #skip-#transcoder, ViT-L/14, Layer 12 = register neuron [reg] "global info highway" inception. ABLATE 13 reg -> train new transcoder. WORSE match, NO reg shortcut > much much BETTER representation of text > ablate accuracy UP! 🤔
4
0
1
Meta just released a new model for verifying Chain-of-Thought reasoning on Hugging Face. It's a TopK transcoder based on Llama 3.1 8B Instruct, offering a white-box method to understand and fix reasoning errors.
2
17
108
Find neurons (circuit tracing / #mechinterp of 'text reading' obsession) in #CLIP, new approach: *SKIP*-#Transcoder. This is looking good! Replace MLP w/ TCODER -> ~same. Finds Vision Transformer Layer 12 'text reading' just like SAE. Hope it holds for <=10 >=17 layers! 🤞🤓
3
0
3
But now let's add a repeated data point to the transcoder training data, p=[1,1,1,0,0,0,0...] The transcoder now learns a special feature to memorize that point!
1
0
21
Top-20 active skip-Transcoder features -> MLP channel -> MLP Hidden. Not as useful for interpreting as the raw numbers, but Sankey diagrams are pretty. 🤗
0
0
1
The #skip-#Transcoder sees your TEXT SMUGGLE doings, #CLIP!🤭 Layer 12. Register Neuron inception. Trained one TCODER on just the image tokens (256) Another on image tokens AND #CLS (all 257). RAGE ADDING @ Channel 650 #usual #suspect 🙃 #latent #information #smuggling #cartel
0
0
0
Steer the vector vector: Worst AI joke ever. Once, in a city that was only a **vector** away from a *punch‑var*, lived a detective named **Clinton Vector**. His office was a maze of *cardinal* directions— ⏹️ Okay, that's enough, little one. Proper Transcoder time for you.🤗
1
0
0
you can now improve RL models WITHOUT ANY TRAINING. Inspired by mechanistic interpretability for LLMs (cred: @jacobdunefsky @mlpowered @NeelNanda5), I applied sparse-transcoder methods to a CartPole policy and saw a +24% performance increase with zero additional training. (1/9)
3
6
29
Let's consider a very simple problem, having a transcoder mimic the absolute value function. You can do this with two features per dimension:
1
0
20
Partially Rewriting a Transformer in Natural Language This work explores rewriting parts of a LLM using natural language explanations while preserving its behavior. A sparse MLP transcoder replaces a feedforward network, with an LLM-based simulator predicting neuron activations
2
3
12
BitSong Studio migration in progress... The new transcoder will support 3 new formats: HLS, AAC, and OPUS.
1
2
14
Editing RAW shouldn’t slow you down. Color Finale Transcoder 2 lets you preview, adjust, and convert RAW footage instantly — with full support for BRAW, N-RAW, Canon CRM, and more. Spend less time waiting and more time creating: https://t.co/Gx3cBr4v1L
#videoediting
0
0
0
Anthropic made an “MRI scanner” for LLMs - the tool is powered by cross-layer transcoder, which effectively looks inside of the inference they saw clusters of neurons forming “circuits”, grouped based on tasks
1
0
1
Using the TickerPlant transcoder (a C# program configured as a NinjaTrader addon) to transcode the market event data for 7 futures contracts simultaneously (NinjaTrader to TickerPlant format.)
0
0
2