התחל במצב לא מקוון עם האפליקציה Player FM !
פודקאסטים ששווה להאזין
בחסות


1 Matthew Lillard and the Glorious Dorito Salad 43:18
Building a Local Large Language Model (LLM)
Manage episode 400054778 series 3086967
Another #ComputingWeek talk turned into a podcast! Two Red Hat software engineers, both recent graduates of SETU, returned to discuss the issues surrounding running your own LLM on a local machine, how models and datasets are built and reduced (quantised) so as to run on a laptop rather than an array of servers. Mark Campbell and Dimitri Saradkis provided excellent insight on the technical issues surround this topic, before getting into some of the ethical and moral issues with host Rob O'Connor at the end.
You can connect with all the people on this podcast on LinkedIn at:
- Mark Campbell https://www.linkedin.com/in/mark-campbell-76846b194/
- Dimitri Saradakis https://www.linkedin.com/in/dimitri-saridakis-32a087139/
- Rob O'Connor https://www.linkedin.com/in/robertoconnorirl/
Here are links to some of the tools referenced in the podcast:
- Red Hat OpenShift AI https://www.redhat.com/en/technologies/cloud-computing/openshift/openshift-ai
- LMStudio https://lmstudio.ai/
- Ollama https://ollama.ai/
- HuggingFace https://huggingface.co/
62 פרקים
Manage episode 400054778 series 3086967
Another #ComputingWeek talk turned into a podcast! Two Red Hat software engineers, both recent graduates of SETU, returned to discuss the issues surrounding running your own LLM on a local machine, how models and datasets are built and reduced (quantised) so as to run on a laptop rather than an array of servers. Mark Campbell and Dimitri Saradkis provided excellent insight on the technical issues surround this topic, before getting into some of the ethical and moral issues with host Rob O'Connor at the end.
You can connect with all the people on this podcast on LinkedIn at:
- Mark Campbell https://www.linkedin.com/in/mark-campbell-76846b194/
- Dimitri Saradakis https://www.linkedin.com/in/dimitri-saridakis-32a087139/
- Rob O'Connor https://www.linkedin.com/in/robertoconnorirl/
Here are links to some of the tools referenced in the podcast:
- Red Hat OpenShift AI https://www.redhat.com/en/technologies/cloud-computing/openshift/openshift-ai
- LMStudio https://lmstudio.ai/
- Ollama https://ollama.ai/
- HuggingFace https://huggingface.co/
62 פרקים
Tutti gli episodi
×
1 CodeGirl and the Conversation: Women in Computing 39:04

1 Garda National Cyber Crime Bureau 38:50

1 Indrakshi Dey - Autonomous Systems and Artificial Intelligence 46:56

1 Nuria Oliver - Big Data, Artificial Intelligence and Addressing Imbalances 55:44

1 Jobs in Computing (Live Panel Discussion) 35:06

1 Building a Local Large Language Model (LLM) 51:30

1 How AI is changing the ICT work environment 47:12

1 Quantum Computing and Quantum Communications 37:21

1 ChatGPT and AI in the Classroom w/ Hazel Farrell and Pete Windle 48:43

1 Red Hat Academy w/ Brendan O'Farrell & Leigh Griffin 1:04:15

1 Wireless Comms on the Farm ... and Mars? 34:54

1 Religion & Video Games (with Frank Bosman) 43:09

1 I Wish I Knew Then What I Know Now (II) 46:33

1 StudyAtHome with Martin Deinhofer and Brendan Jackman 33:18

1 Learning Your Second Programming Language 32:28

1 From There To Here: 50-Odd Years of WIT 1:13:44

1 Update and Introducing 9plus (Female Researchers) 41:29


1 Mícheál Ó'Foghlú (Google Engineering Director, Core Developer unit) 59:53



1 What 3rd Level Needs To Know About 2nd Level Computer Science 1:02:10

1 Leaving Cert Computer Science & more with Brett Becker 1:00:39


1 Final Year Projects & The Sun Life Awards 42:43

1 Virtual, Augmented and Mixed Reality 51:15

1 The Walton Institute and ICT Research at WIT 48:02



1 Developer Stories: Rocketship Park Games w/ Shane McCafferty 43:53


1 A Beginner's Guide To Cybersecurity 1:01:22

1 Developer Stories: COVIDTracker App 1:23:32

1 Online Learning: The Student Perspective 27:58

1 Online Learning: The Lecturer Perspective 45:40

1 COVID-19 Treatment Research at WIT 37:43

1 Technology vs COVID-19 from WIT Research 51:19





1 Student Experience of Online Learning 44:52

ברוכים הבאים אל Player FM!
Player FM סורק את האינטרנט עבור פודקאסטים באיכות גבוהה בשבילכם כדי שתהנו מהם כרגע. זה יישום הפודקאסט הטוב ביותר והוא עובד על אנדרואיד, iPhone ואינטרנט. הירשמו לסנכרון מנויים במכשירים שונים.