IQmates

@UCGG_Ub823BZeaMnuo7k91Wg - 2.1K subscribers

Knowledge Shared... Mates from all over the world coming together, sharing what gives people true power and freedom - knowledge. From the arts to the sciences, from general knowledge to academic knowledge, this is the home of everything there is to know.

Home Videos Live Playlists

More on the GPT Architecture

More on the GPT Architecture IQmates

21 views - 1 year ago

Datasets IQmates

9 views - 1 year ago

Introduction to Transformer Architecture Part 2

Introduction to Transformer Architecture Part 2 IQmates

2 views - 1 year ago

Introduction to Transformer Architecture Part 1

Introduction to Transformer Architecture Part 1 IQmates

18 views - 1 year ago

Stages of building an LLM

Stages of building an LLM IQmates

17 views - 1 year ago

Introduction to LLMs

Introduction to LLMs IQmates

68 views - 1 year ago

Course Structure

Course Structure IQmates

6 views - 1 year ago

Working with Text Data

Working with Text Data IQmates

6 views - 1 year ago

Word Embeddings

Word Embeddings IQmates

5 views - 1 year ago

Tokenising Splitting Texts

Tokenising Splitting Texts IQmates

2 views - 1 year ago

TokenIDs from a Vocabulary

TokenIDs from a Vocabulary IQmates

1 views - 1 year ago

Adding Special Tokens

Adding Special Tokens IQmates

39 views - 1 year ago

Byte Pair Encoding

Byte Pair Encoding IQmates

18 views - 1 year ago

Data Sampling with Sliding Window

Data Sampling with Sliding Window IQmates

14 views - 1 year ago

Creating token embeddings

Creating token embeddings IQmates

14 views - 1 year ago

Adding positional embeddings

Adding positional embeddings IQmates

5 views - 1 year ago

Summary of data preparation

Summary of data preparation IQmates

1 views - 1 year ago

Introduction IQmates

4 views - 1 year ago

Challenges of Long Sequences

Challenges of Long Sequences IQmates

11 views - 1 year ago

RNNs and Bahdanau Attention Mechanism

RNNs and Bahdanau Attention Mechanism IQmates

885 views - 1 year ago

Simple Self Attention Mechanism

Simple Self Attention Mechanism IQmates

28 views - 1 year ago

Simple Self Attention for all Inputs

Simple Self Attention for all Inputs IQmates

3 views - 1 year ago

Self Attention with Trainable Weights

Self Attention with Trainable Weights IQmates

30 views - 1 year ago

Scaled Dot Product Self Attention on all Inputs

Scaled Dot Product Self Attention on all Inputs IQmates

28 views - 1 year ago

Causal or Masked Attention

Causal or Masked Attention IQmates

208 views - 1 year ago

Adding dropout to causal attention

Adding dropout to causal attention IQmates

36 views - 1 year ago

Causal Attention for all inputs

Causal Attention for all inputs IQmates

4 views - 1 year ago

Multi head Attention

Multi head Attention IQmates

2 views - 1 year ago

Multi head attention with weight splitting

Multi head attention with weight splitting IQmates

6 views - 1 year ago

Summary of Attention Mechanisms

Summary of Attention Mechanisms IQmates

8 views - 1 year ago

Building the LLM Architecture

Building the LLM Architecture IQmates

1 views - 1 year ago

Creating the GPT 2 Model's Backbone

Creating the GPT 2 Model's Backbone IQmates

4 views - 1 year ago

Layer Normalisation

Layer Normalisation IQmates

2 views - 1 year ago

Feed forward network with GELU activation

Feed forward network with GELU activation IQmates

35 views - 1 year ago

Adding shortcut connections

Adding shortcut connections IQmates

2 views - 1 year ago

Connecting attention and linear layers into the transformer block

Connecting attention and linear layers into the transformer block IQmates

7 views - 1 year ago

Coding the GPT Model Consolidating everything

Coding the GPT Model Consolidating everything IQmates

1 year ago

Generating text with our GPT model

Generating text with our GPT model IQmates

1 year ago

Summary IQmates

1 year ago

Adding shortcut connections

Adding shortcut connections IQmates

1 views - 1 year ago

Connecting attention and linear layers into the transformer block

Connecting attention and linear layers into the transformer block IQmates

8 views - 1 year ago

Coding the GPT Model Consolidating everything

Coding the GPT Model Consolidating everything IQmates

1 year ago

Generating text with our GPT model

Generating text with our GPT model IQmates

1 year ago

Summary IQmates

1 views - 1 year ago

Steps to pretrain a Large Language Model

Steps to pretrain a Large Language Model IQmates

5 views - 1 year ago

Generating text again with GPTModel

Generating text again with GPTModel IQmates

5 views - 1 year ago

Cross entropy loss and Perplexity Measuring model performance

Cross entropy loss and Perplexity Measuring model performance IQmates

67 views - 1 year ago

Setting up training and validation datasets

Setting up training and validation datasets IQmates

8 views - 1 year ago

Training the Large Language Model

Training the Large Language Model IQmates

1 year ago

Adding randomness via temperature scaling

Adding randomness via temperature scaling IQmates

2 views - 1 year ago

Adding randomness via top k sampling

Adding randomness via top k sampling IQmates

1 views - 1 year ago

Updated text generation function with top k sampling and temperature scaling

Updated text generation function with top k sampling and temperature scaling IQmates

16 views - 1 year ago

Checkpointing saving the model and loading the weights

Checkpointing saving the model and loading the weights IQmates

10 views - 1 year ago

Loading GPT 2 weights from OpenAI

Loading GPT 2 weights from OpenAI IQmates

42 views - 1 year ago

Summary IQmates

4 views - 1 year ago

Course Introduction

Course Introduction IQmates

33 views - 1 year ago

Python Code Discussion - Classification

Python Code Discussion - Classification IQmates

51 views - 1 year ago

Python Code Discussion - Regression

Python Code Discussion - Regression IQmates

36 views - 1 year ago

Explaining IQmates Gig

Explaining IQmates Gig IQmates

23 views - 2 years ago

What exactly is IQmates?

What exactly is IQmates? IQmates

23 views - 2 years ago