ChiDotPhi

@UCo8HIr2vN5PzV8yB8ehoiRw - 3.8K subscribers

Mostly Theoretical Physics stuff

Home Videos Live Playlists

AI paper overview (03/26/26) - Attention Residual, Olmo Hybrid, Mixture of Depth Attention

AI paper overview (03/26/26) - Attention Residual, Olmo Hybrid, Mixture of Depth Attention ChiDotPhi

82 views - 3 weeks ago

Weekly AI Paper - 09/05/25 - 2-Simplex attention, Mixture of Recursion, Supress wait tokens

Weekly AI Paper - 09/05/25 - 2-Simplex attention, Mixture of Recursion, Supress wait tokens ChiDotPhi

145 views - 7 months ago

Weekly AI paper - 8/30/25 - Falcon-H1, CoT Mirage, GSPO

Weekly AI paper - 8/30/25 - Falcon-H1, CoT Mirage, GSPO ChiDotPhi

98 views - 7 months ago

Jax tutorial 4: JIT

Jax tutorial 4: JIT ChiDotPhi

214 views - 9 months ago

Jax tutorial 3: PMAP and VMAP

Jax tutorial 3: PMAP and VMAP ChiDotPhi

431 views - 9 months ago

Jax tutorial 2: Grads

Jax tutorial 2: Grads ChiDotPhi

114 views - 9 months ago

Jax tutorial 1: Arrays

Jax tutorial 1: Arrays ChiDotPhi

551 views - 10 months ago

Weekly AI paper - 4/7/25 - LLAMA4, Multi token attention

Weekly AI paper - 4/7/25 - LLAMA4, Multi token attention ChiDotPhi

94 views - 1 year ago

Weekly AI paper review - 3/28/25 - Large Memory module, LongRope2, MOBA block attention

Weekly AI paper review - 3/28/25 - Large Memory module, LongRope2, MOBA block attention ChiDotPhi

59 views - 1 year ago

Weekly AI paper review - 2/14/25 - S1 Test time scaling, SMOLLM2

Weekly AI paper review - 2/14/25 - S1 Test time scaling, SMOLLM2 ChiDotPhi

398 views - 1 year ago

Weekly AI paper review - 2/7/25 - RL generalizes, Titans: Learning to Memorize at test time.

Weekly AI paper review - 2/7/25 - RL generalizes, Titans: Learning to Memorize at test time. ChiDotPhi

81 views - 1 year ago

Weekly AI paper review - 1/23/25 - Transformers^2, Tensor Product Attention, Deepseek-R1

Weekly AI paper review - 1/23/25 - Transformers^2, Tensor Product Attention, Deepseek-R1 ChiDotPhi

621 views - 1 year ago

VSCode environment and extensions for Python Development

VSCode environment and extensions for Python Development ChiDotPhi

80 views - 1 year ago

Weekly AI paper overview - 12/23/2024 - Deepseekv3, Memory layers

Weekly AI paper overview - 12/23/2024 - Deepseekv3, Memory layers ChiDotPhi

148 views - 1 year ago

6. Final Words ChiDotPhi

34 views - 1 year ago

5. Training the MLLM

5. Training the MLLM ChiDotPhi

107 views - 1 year ago

Weekly AI paper overview - 12/23/2024 - ModernBERT, No More Adam

Weekly AI paper overview - 12/23/2024 - ModernBERT, No More Adam ChiDotPhi

789 views - 1 year ago

Weekly AI paper overview - 12/19/24 - Latent Space Reasoning , Byte Latent Transformer

Weekly AI paper overview - 12/19/24 - Latent Space Reasoning , Byte Latent Transformer ChiDotPhi

512 views - 1 year ago

5. Dataloader for MLLM

5. Dataloader for MLLM ChiDotPhi

71 views - 1 year ago

4. Writing MLLM from scratch

4. Writing MLLM from scratch ChiDotPhi

316 views - 1 year ago

Torchtune: A new finetuning library for LLMs

Torchtune: A new finetuning library for LLMs ChiDotPhi

436 views - 1 year ago

3. Vision base - Clip-14

3. Vision base - Clip-14 ChiDotPhi

67 views - 1 year ago

Weekly AI paper overview- 10/29/24 - Pixtral, Differential Transformers

Weekly AI paper overview- 10/29/24 - Pixtral, Differential Transformers ChiDotPhi

328 views - 1 year ago

Weekly AI paper overview- 10/1/24 - LLAMA3.2, Self correction using RL

Weekly AI paper overview- 10/1/24 - LLAMA3.2, Self correction using RL ChiDotPhi

107 views - 1 year ago

Part 4 : Trainer

Part 4 : Trainer ChiDotPhi

63 views - 1 year ago

Part 3: Training Script

Part 3: Training Script ChiDotPhi

24 views - 1 year ago

Part 1 : OLMO Paper

Part 1 : OLMO Paper ChiDotPhi

104 views - 1 year ago

Part 2 : The model definition

Part 2 : The model definition ChiDotPhi

127 views - 1 year ago

Weekly AI paper overview - 7/25/2024

Weekly AI paper overview - 7/25/2024 ChiDotPhi

77 views - 1 year ago

Weekly AI paper overview- 7/7/24

Weekly AI paper overview- 7/7/24 ChiDotPhi

63 views - 1 year ago

Weekly AI paper overview- 6/18/24

Weekly AI paper overview- 6/18/24 ChiDotPhi

148 views - 1 year ago

Weekly AI paper overview- 6/9/24

Weekly AI paper overview- 6/9/24 ChiDotPhi

368 views - 1 year ago

2. LLM base - Phi3

2. LLM base - Phi3 ChiDotPhi

263 views - 1 year ago

Weekly AI paper overview- 5/9/24

Weekly AI paper overview- 5/9/24 ChiDotPhi

819 views - 1 year ago

1. Architecture overview of MLLM: MiniGPT4

1. Architecture overview of MLLM: MiniGPT4 ChiDotPhi

1.3K views - 1 year ago

Halide 4 - Multi-Stage Scheduling

Halide 4 - Multi-Stage Scheduling ChiDotPhi

411 views - 3 years ago

All About Normalizations! - Batch, Layer, Instance and Group Norm

All About Normalizations! - Batch, Layer, Instance and Group Norm ChiDotPhi

19.8K views - 4 years ago

PyTorch - torch.jit Optimize your model

PyTorch - torch.jit Optimize your model ChiDotPhi

3.2K views - 4 years ago

PyTorch - Convolution under the hood (Unfolding/Folding)

PyTorch - Convolution under the hood (Unfolding/Folding) ChiDotPhi

6K views - 4 years ago

PyTorch - Transformer code walkthrough - Part 2 Actual Code

PyTorch - Transformer code walkthrough - Part 2 Actual Code ChiDotPhi

2.7K views - 4 years ago

PyTorch - Transformer code walkthrough - Part 1 Theory

PyTorch - Transformer code walkthrough - Part 1 Theory ChiDotPhi

4K views - 4 years ago

Halide 3 - Scheduling Basics

Halide 3 - Scheduling Basics ChiDotPhi

435 views - 4 years ago

PyTorch - Dataset and Datastores

PyTorch - Dataset and Datastores ChiDotPhi

541 views - 4 years ago

Halide 2 - Hello World

Halide 2 - Hello World ChiDotPhi

425 views - 4 years ago

PyTorch - Creating Custom Layers

PyTorch - Creating Custom Layers ChiDotPhi

4.8K views - 4 years ago

Halide 1 - Windows Setup

Halide 1 - Windows Setup ChiDotPhi

1.3K views - 4 years ago

PyTorch - Neural Network II - nn.Module

PyTorch - Neural Network II - nn.Module ChiDotPhi

2.3K views - 4 years ago

Coding Challenge || Google || Keys and Rooms || C++ and Python

Coding Challenge || Google || Keys and Rooms || C++ and Python ChiDotPhi

50 views - 4 years ago

Coding Challenge || Microsoft || Sort Characters By Frequency || C++ and Python

Coding Challenge || Microsoft || Sort Characters By Frequency || C++ and Python ChiDotPhi

50 views - 4 years ago

PyTorch - Neural Network I - nn.Sequential

PyTorch - Neural Network I - nn.Sequential ChiDotPhi

4.8K views - 4 years ago

1000000th video on GitHub Copilot

1000000th video on GitHub Copilot ChiDotPhi

203 views - 4 years ago

PyTorch - Automatic Differentiation

PyTorch - Automatic Differentiation ChiDotPhi

749 views - 4 years ago

Coding Challenge || Right Side View || C++ and Python

Coding Challenge || Right Side View || C++ and Python ChiDotPhi

48 views - 4 years ago

Coding Challenge || Google || Max level order Sum || C++ and Python

Coding Challenge || Google || Max level order Sum || C++ and Python ChiDotPhi

92 views - 4 years ago

PyTorch - Introduction and Tensors

PyTorch - Introduction and Tensors ChiDotPhi

1.2K views - 4 years ago

Tmux basics - Must have terminal tool!!

Tmux basics - Must have terminal tool!! ChiDotPhi

183 views - 4 years ago

Quantum Algorithm - 3 Implementation

Quantum Algorithm - 3 Implementation ChiDotPhi

231 views - 4 years ago

Quantum Algorithm - 2 Quantum Solution Theory

Quantum Algorithm - 2 Quantum Solution Theory ChiDotPhi

142 views - 4 years ago

Quantum Algorithm - 1 Classical Solution

Quantum Algorithm - 1 Classical Solution ChiDotPhi

250 views - 4 years ago

Quantum Programming - Quantum Gates II

Quantum Programming - Quantum Gates II ChiDotPhi

271 views - 4 years ago