Ray Fernando, a former Apple engineer, gives an in-depth tutorial on DeepSeek AI and local model implementation. The conversation includes detailed guide for setting up local AI environments using Docker and OpenWebUI, and how to implement DeepSeek on mobile using the Apollo app.
Key Points:
• Comprehensive overview of DeepSeek AI and its reasoning capabilities
• Discussion of data privacy concerns when using Chinese-hosted models
• Detailed tutorial on running AI models locally using Docker and OpenWebUI
• Comparison of different AI model providers (Fireworks, Grok, OpenRouter)
• Mobile implementation of AI models using Apollo app
Timestamps:
00:00 – Introduction
02:21 – Overview of DeepSeek
05:16 – Data privacy concerns with Chinese-hosted models
07:49 – Running Models Locally with OpenWebUI
09:53 – Comparing Hosting Providers: Fireworks and Grok
16:41 – Cost Comparison of using/running AI Models
18:22 – Improving Prompts for Better Outputs
22:28 – Running AI Models Locally: A Step-by-Step Guide
36:56 – Mobile AI implementation discussion
45:14 – Future implications and closing thoughts
1) DeepSeek’s R1 Model – What’s the big deal?
• On par with ChatGPT’s reasoning capabilities
• Open source & free to use
• BUT hosted in China (data privacy concerns)
• Incredible for analysis and content generation
2) Alternative Ways to Use DeepSeek:
• Fireworks AI ($8/million tokens)
• OpenRouter
• Grok API
• Local hosting (safest for sensitive data)
3) Running AI Models Locally
Step-by-step setup:
• Install Docker
• Use OpenWebUI
• Download models via Ollama
• Configure API connections
Pro tip: Takes 5 mins to set up, saves hours of worry about data privacy
4) Mobile AI is HERE!
• Apollo app lets you run models locally on phone
• Download smaller, optimized models
• Works offline
• Perfect for quick analysis on the go
5) Temperature Settings Explained:
High temp (0.8-1.0) = Creative mode
Low temp (0-0.3) = Logical mode
Choose based on your needs!
6) FUTURE PREDICTIONS
• Watch-based AI coming soon
• Emergency response applications
• Real-time negotiation assistance
• Advanced audio analysis
7) Getting Started Tips:
• Start with public data on DeepSeek
• Experiment with different models
• Use temperature settings wisely
• Focus on practical use cases
Notable Quotes:
"We’re in this new deep-seek world where if you figure out the model that works for you and the tasks that you want to accomplish, you might be able to out-compete whoever you’re competing against." – Greg
"Please don’t be fearful or don’t feel like you’re left behind. If you’re just finding out about this, you’re not that far behind. We’re all actually still trying to understand what this intelligence can give us." – Ray Fernando
LCA helps Fortune 500s and fast-growing startups build their future – from Warner Music to Fortnite to Dropbox. We turn ‘what if’ into reality with AI, apps, and next-gen products https://latecheckout.agency/
BoringAds — ads agency that will build you profitable ad campaigns http://boringads.com/
BoringMarketing — SEO agency and tools to get your organic customers http://boringmarketing.com/
Startup Empire – a membership for builders who want to build cash-flowing businesses https://www.startupempire.co
FIND ME ON SOCIAL
X/Twitter: https://twitter.com/gregisenberg
Instagram: https://instagram.com/gregisenberg/
LinkedIn: https://www.linkedin.com/in/gisenberg/
FIND RAY ON SOCIAL
X/Twitter: https://x.com/RayFernando1337
YouTube: https://www.youtube.com/@RayFernando1337
Ray’s Website: https://www.rayfernando.ai
