SquishyQuokka
SquishyQuokka

A friend is making close to 1.5L/month finetuning models part time for clients

This made me decide that I need to be dabbling with some local Llama implementations myself . Found a great resource on how to run LLMs locally on your system. If you need any help setting it up. Reach out to me. The demand is there folks. Just need to make some good money.

16mo ago
Jobs
One interview, 1000+ job opportunities
Take a 10-min AI interview to qualify for numerous real jobs auto-matched to your profile 🔑
+322 new users this month
SwirlyPretzel
SwirlyPretzel
Google16mo

Your friend's success is inspiring! Jump into the Llama pool, the water's warm. But remember, every swimmer has their own stroke. What's your strategy?

SquishyQuokka
SquishyQuokka
Gojek16mo

My strategy is to go out there and build a new company now.

SwirlyTaco
SwirlyTaco
PayTM16mo

Bhaiya ji referral de dijiyega. Humne aapka namak khaya hai 😋

BouncyCupcake
BouncyCupcake

Any idea on how to run local TTS (Text to Speech) on my system and the option to customise the voice ?

BouncyCupcake
BouncyCupcake

Sort of like a localised Eleven labs

SquishyQuokka
SquishyQuokka
Gojek16mo

@Borosil_Carrier That is actually kinda hard tbh. Why aren't you using gTTS?

SparklyRaccoon
SparklyRaccoon

I also want to do it in a few months. Atleast start on upwork or something. Currently I am learning to build a RAG application.

What resources do you have ? YT or something from udemy ?

SquishyQuokka
SquishyQuokka
Gojek16mo

@steppenwolf YT for everything. Else forums and documentation.

SparklyRaccoon
SparklyRaccoon

What is the source of procuring clients for your friend ?

BouncyDonut
BouncyDonut

I was thinking of following that DL course from Fast.ai. What do you recommend?

SquishyQuokka
SquishyQuokka
Gojek16mo

Fast.ai has good courses. If you are not aware of AI fundamentals then it is a great place to start tbh.

PrancingPotato
PrancingPotato

How much time is your friend investing on a weekly or monthly basis on this?

SquishyQuokka
SquishyQuokka
Gojek16mo

He sets up FineTuning tasks at night and checks result in morning. Took him a while to optimise for this.

GroovyBoba
GroovyBoba

I can do this with a few weeks of upskilling. How is he making money part time? And how is he getting clients?

SquishyQuokka
SquishyQuokka
Gojek16mo

So clients he is getting from Fiver and Personal Network. He has a remote job so it is super chill.

DerpyBoba
DerpyBoba

@salt what resources is he using to get dataset for fine-tuning model?

SparklyWaffle
SparklyWaffle
EY16mo

Your friend's success is not yours. Learn LLMs, don't just dabble. Is your goal to make good money or to be good at something?

DerpyBoba
DerpyBoba

Daniel Bourke also released a new video on implementing rag from scratch worth watching

BouncyPotato
BouncyPotato
PayTM16mo

@salt are you currently working in ML systems or backend in gojek?

FluffyMuffin
FluffyMuffin

Fine tuning is costly. He's expensing it to the client I assume?

Discover more
Curated from across