decoder-model

a LLM cookbook, for building your own from scratch, all the way from gathering data to training a model

Experimental project for AI and NLP based on Transformer Architecture

This repository features a custom-built decoder-only language model (LLM) with a total of 37 million parameters 🔥. I train the model to be able to ask question from a given context

🚀 从零亲手训练大语言模型（LLM）——全流程实战教程！涵盖数据清洗与预处理、自定义Tokenizer训练、模型架构搭建、从头预训练，以及指令微调（SFT）。没有黑盒，不依赖现成API，保姆级手把手带你打造属于自己的LLM，深入理解大模型的每一处细节。

Implementation of the GPT-3 paper: Language Models are Few-Shot Learners

Generate caption on images using CNN Encoder- LSTM Decoder structure

Transformers Intuition

This repo represents my Nano-GPT speedrun playground, which started coding along Let's reproduce GPT-2 (124M), then moved into further improvements.

Generative AI fine-tune and inference for sequence classification tasks

This project aims to simplify texts from research papers using advanced natural language processing (NLP) techniques, making them more accessible to a broader audience

Code and dataset used to train dialect adapters for decoder models.

This project focuses on the implementation of inverting I-JEAP, a new architecture designed to simulate human intelligence through self-supervised learning. Our goal is to invert the embeddings to demonstrate that such architectures can be vulnerable to inversion attacks

a dna sequence generation/classification using transformers

Deep Learning collection covering fundamentals, Computer Vision, NLP, sequential models, and hands-on implementations.

On the Design and Performance of Machine Learning Based Error Correcting Decoders

An LLM based tool for generation of cheese advirtisements

Text Generation using RNN, LSTM, and Transformer

Clavier is a language model that generates sheet music and MIDI files in the style of classical composers

Custom decoder Transformer that treats a patient's medical journey like a story told through diagnosis codes instead of words.

Build Text summarizer for arabic language