Technical-University-Intell.../README.md
2024-09-19 10:39:28 +00:00

1.6 KiB

Technical University Intelligent System

Add files

  • Create or upload files
  • Add files using the command line or push an existing Git repository with the following command:
cd existing_repo
git remote add origin https://git.bidonov.xyz/TUIS/Technical-University-Intelligent-System.git
git branch -M main
git push -uf origin main

Collaborate things done so far

  • Invite team members and collaborators
  • Automatically close issues from merge requests
  • Enable merge request approvals
  • Set auto-merge

Description

Finetuned LLM specifically made for TU Sofia

Installation

Coming soon

Usage

Coming soon

Support

It works on my PC lol - you can contact me over at tarkan@bidonov.xyz or message me on matrix @tarkan:bidonov.xyz

Roadmap

  • Pick a base model for finetune
  • Pick and optimize the inference framework
  • Pick and optimize the finetuning framework
  • Test and iron out the qurks in the frameworks
  • Making a finetune as proof of concept that everything works and it is optimal
  • Testing the model with both the local inference and API inference
  • Making the dataset
  • Making the eval dataset
  • Running training steps for QLoRA, LoRA and Full-Finetune
  • Deploying and final touches

Authors and acknowledgment

License

This Project Uses the MIT License

Project status

The project is in active development