🧵 1/n I am participating in @Supabase's AI Hackathon and challenging myself to complete "Chat With Any Video" in ≤24 hours. 👨🏻‍💻 Based on #ChatGPT and #Whisper API, all code will be Open Source, I'll continue to update here during breaks. 🔔 Follow me. https://t.co/Y14z5xOU2x
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 16, 2023

First of all, let me introduce my special team - I've created an AI virtual army with #ChatGPT, #GPT4, #Claude, #Cursor, and others who will be my trusted allies! First thing on the agenda is to give this project a name. I asked ChatGPT for suggestions and got some good options: https://t.co/1rVl9GXnC2
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 16, 2023

3/n My favorite is ChatVox. Vox is Latin for voice, and my goal is to have conversations with any audio and video transcripts through GPT. I also thought of ChatWise, but it was already taken by another brand - what a bummer! It meant "chat with wisdom"🤣 https://t.co/YZ5nIHIsRB
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 16, 2023

4/n So, let's settle on "ChatVox" and the GitHub repository is already set up. https://t.co/wdcfxFIIgZ
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 16, 2023

5/n With @Vercel, it goes live from the moment it is created, keeping CI/CD alive. 🔥 https://t.co/DcnKU8qNoP https://t.co/fIaCnRmiit
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 16, 2023

7/n I just finished setting up the @Supabase database and set up some useful NPM scripts. pgvector is an extension for PostgreSQL that allows you to both store and query vector embeddings within your database. https://t.co/1qBrsU6D5c https://t.co/lvQfFla0OU
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 16, 2023

8/n Having just completed proof-of-concept for @LangChain and Supabase Hybrid Search, @Supabase's new dbdev feature is super awesome! https://t.co/9MDDKLA113 https://t.co/kDX4OOEhJP
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 16, 2023

9/n 🎉 So excited! @LangChainAI successfully answered my question, based on the search results and the most relevant parts given by @Supabase! The video material I'm using is "Steve Jobs' 2005 Stanford Commencement Address" https://t.co/NNBrfr2CP2 https://t.co/qHen9kispZ
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 16, 2023

10/n 🎉 I'm beaten, but I can finally chat with YouTube videos now! The UI part is done, but there were just so many little details. Time to go to bed, see you all tomorrow. It's too late and... Hope I don't miss the deadline for the final submission. https://t.co/C363oEprrV
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 16, 2023

11/n Submitted at the last minute! 🌩 https://t.co/qX7fyHZCIT
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 17, 2023

12/n LOL, it looks like I'm wrong about the time zone, and there are still 2 hours to go 🤣 But I just got my hands shaking with excitement because the uploaded image kept loading, and I re-refreshed the page to fill it in. @Supabase (Fortunately, I have a clipboard record, 😛 https://t.co/xtS9aB0TMf
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 17, 2023

13/n Let me take a break to explain the new features of #ChatVox: 🔍 Hybrid Search for all saved videos: 1. #ChatVox Result: GPT AI will just give you an answer, like boom! 2. Search Results: Find what you want to watch 3. Relevant Results: Others related to your search query https://t.co/elFDsgQYu2
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 17, 2023

14/n @LangChainAI & @Supabase is my virtual army! 🏄 Too powerful! I can't imagine getting it done in 24 hours, even though I still have a lot to do! The latest magic is here: https://t.co/h3pXT9jbQn https://t.co/ZGhOjfl8Lc
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 17, 2023

15/n #ChatVox · Chat With Any Video 🔥 Talking to a video is essentially talking to this person, It meant "chat with wisdom" 🤣 Welcome to give it a try 👇 🔗 https://t.co/DcnKU8qNoP 🔗 https://t.co/4gqGWbadBX 🔗 https://t.co/ixZnnbQtQh
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 17, 2023

16/n Finally, thank you for your attention, 🥳 some screenshots to represent my #ChatVox: Chat With Any Video 1. ➕ Add Video (https://t.co/DSX9JffhMJ link) 2. ⇨ Ask Question 3. 🪂 Jump to Timestamp 4. 🔍 Search from *All* ⭐️ Welcome to Star on GitHub: https://t.co/wdcfxFIIgZ https://t.co/sd0ljWzJVO
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 17, 2023

Requesting $CSB funds from the Faucet on the #Crossbell blockchain. Address: 0xb4d7E965bd043b9b633EcA43DF3Ac82c7A545cA3. https://t.co/vm3hm2cnTC
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 18, 2023

🥳 Fantastic! 1-click to share your AI idea! https://t.co/KgUaKfbRzv
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 20, 2023

上周末又是几场黑客马拉松，冲刺一下，完成了我最初的愿景，压线提交！🤣

视频地址：https://ift.tt/inhjaC3



Media

via 吕立青_JimmyLv 的 bilibili 动态 https://ift.tt/MczFN2q

【ChatVox】Chat directly with video with AI? A new dialogue mode for audio and video interaction Finally, I made a video to introduce it! Although it is Mandarin, it has subtitles! You can also chat with "this video" across time and space.🫡 https://t.co/NqRCVmDgzY
— JimmyLv.eth (🐣, 🐣) 吕立青 2𐃏22 🇨🇳 (@Jimmy_JingLv) Apr 20, 2023

人工智能体之间的自动化互动，以自然语言的形式呈现，支持回顾追溯和版本分叉，太期待了！我在ChatGPT的自主那次直播中，也提到了未来“人机互动”的可组合形态：单人单机 -> 单人多机 -> 多人多机的互动，未来真的到来得还不够快！

//转发自: @失重_HankYuan: 西部世界来了？Stanford如何用ChatGPT打造NPC小镇


视频地址：https://ift.tt/98HSdpG



Media

via 吕立青_JimmyLv 的 bilibili 动态 https://ift.tt/Trf09Ip