Transformer AIs for Managers? Can someone PLZ Tutor me? I have $$ for you
Hi guys, I am a TEDx talker and CEO who wants to use AI in my companies BUT I am having a hard time understanding the stuff on this forum - I am not a programmer (although I did code some JS in the 90s).I am interested in AI chat bots made from TRANSFORMERS like BERT (I think?)I am already very knowledgeable in GPT3 - i want to make something from scratch and not pay API fees…Can someone point me in the direction of a turtorial or book for BEGINNERS? Not even coding per se, but what open source AI is (are they all transformers or more?), what is available, what it can do, who i should i hire to work on it, what we can accomplish, how much will that cost, what should i expect? Etc.If no book or online resource for managers exists, or even if it does, can I pay someone $100 per hour to tutor me on it? Or more if you want, I just need someone to get me grounded hereI promise to learn fast!!!and not be a painthanks very much for your time! sorry in advance if this is not the right forum for this kind of question
2021-02-02T17:33:22Z
Hi@joshbachynski, I’m not aware of a single resource that has answers to all your questions (especially the ones about who to hire, costs, expectations etc), but here’s a few resources I found useful when trying to grok Transformers at a conceptual level:Jay Alammar’sblog posts, starting with eitherThe Illustrated TransformerorThe Illustrated BERT, ELMo, and co.TheTopBotsresearch summaries. Since you’re interested in chat bots, you could look at the conversational AI sectionhere. They also have a lot of content aimed at enterprises, which might help answer your broader questionsRegarding these questionswhat open source AI is (are they all transformers or more?), what is available, what it can dothe short, but incomplete answer is that open source AI/ML is a HUGE ecosystem of libraries and communities (e.g. PyTorch / TensorFlow / HuggingFace / spaCy / fastai / scikit-learn / …) and applications involving Transformers are mostly in the NLP domain, but quickly growing to computer vision, reinforcement learning, and other fields.Hope that helps!
2021-02-02T19:11:11Z
Thanks very much! can we interface over email or zoom, so i can pick your brain on this a bit? i can pay you for your time, just name your hourly costi will schedule anytime that is convenient for you! thanks very much in advance!i won’t be annoying lol ;p
2021-02-03T08:05:27Z
Thanks for the offer@joshbachynskibut I’m not in a position right now to take on new projectsIn the meantime, feel free to post any questions you have in the forum - I don’t think anything is “off-limits” as long as it’s broadly about Transformers / NLP (which raises the chance someone in the community will know the answer).
2021-02-03T12:32:16Z
For a more general approach to how to lead AI projects this can be helpful:AI For EveryoneCourseraAI For EveryoneOffered by DeepLearning.AI. AI is not only for engineers. If you want your organization to become better at using AI, this is the course to ... Enroll for free.Structuring Machine Learning ProjectsCourseraStructuring Machine Learning ProjectsOffered by DeepLearning.AI. In the third course of the Deep Learning Specialization, you will learn how to build a successful machine ... Enroll for free.
2021-03-02T21:13:51Z
Gpt3 is even old tech now. Now we have qnlp, gattNN etc…
2021-03-02T21:25:58Z
Great! When can we meet to discuss it?
2021-11-10T20:58:14Z
Hi Joshua!You posted it a while ago, is the topic still relevant?I’m not qualified to give you the kind of help you are looking for. I’m new to transformers, although I have 3 years in ML. I am an entrepreneur myself and I totally totally understand your pain. If you are still interested, we can talk. I will not charge you anything. And I might only be useful with some relatively general directions. As I said, I am new to transformers.-Alex
2021-11-10T21:11:51Z
sure please email me atjoshbachynski@gmail.com
2021-11-16T07:47:56Z
Hi@joshbachynskiAs an answer to your " GPT3 - i want to make something from scratch and not pay API fees…"I can suggest a more elegant and free model , namely iPET, as an alternative to GPT3. According to the article, it is more successful than GPT3, and you can train any model you want with very few examples, I mean few shot learning,arXiv.orgExploiting Cloze Questions for Few Shot Text Classification and Natural...Some NLP tasks can be solved in a fully unsupervised fashion by providing a
pretrained language model with "task descriptions" in natural language (e.g.,
Radford et al., 2019). While this approach underperforms its supervised
counterpart, we show in...GitHubGitHub - timoschick/pet: This repository contains the code for "Exploiting...This repository contains the code for "Exploiting Cloze Questions for Few-Shot Text Classification and Natural Language Inference" - GitHub - timoschick/pet: This repository contains the ...The second more fresh work is  T0huggingface.cobigscience/T0pp · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.
2021-11-16T18:59:02Z
great thx! I really appreciate it!