Clip from session
Sara Hooker - The changing spaces of research breakthroughs
This conversation explores the evolving landscape of research, particularly in AI, emphasizing the importance of mentorship, collaboration, and the need for a more inclusive approach to research. Sara Hooker, Head of Cohere Labs, discusses the historical context of research, the impact of the printing press, and the challenges faced by independent researchers. Key principles for success in research are shared, along with insights on navigating career paths in academia and industry. The importance of community building and the role of usable artifacts in research are also highlighted.
Clip from session
A panel conversation on research question ideation, hosted by Marzieh Fadaee, with panelists Stella Birderman, Mostafa Dehghani, Eugene Cheah
This session focuses on the process of research ideation in machine learning, featuring a panel of experts who share their strategies for generating research ideas, the importance of collaboration, and the common pitfalls to avoid. The discussion emphasizes the need for researchers to think critically about existing literature, explore under-researched areas, and communicate their ideas effectively. The panelists also highlight the significance of personal motivation and the value of working with others in the research community.
Clip from session
Your journey into research: lessons to live by with Sara Hooker
This conversation explores the journey of becoming a machine learning researcher, discussing the challenges and opportunities within the research landscape. It emphasizes the importance of collaboration, mentorship, and choosing meaningful research topics. Sara Hooker, Head of Cohere Labs, share insights on best practices for conducting research, handling failure, and managing time effectively. Networking and building relationships within the research community are highlighted as key components for success in the field.
Clip from session
Journey of a Research Paper with Ahmet Üstün and Marzieh Fadaee
This session focuses on demystifying the journey of becoming a machine learning researcher, providing practical tips on experimental management, writing research papers, structuring papers, seeking feedback, and effectively presenting research. The speakers emphasize the importance of clarity, organization, and storytelling in research, along with the value of community support and engagement.
Clip from session
Scientific Communication with Marzieh Fadaee, Jay Alammar and Shayne Longpre
This conversation explores the nuances of scientific communication in AI research, emphasizing the importance of writing, visual elements, and storytelling. The speakers discuss strategies for effective collaboration, adapting communication for different audiences, and the role of visualizations in enhancing understanding. They also share insights on oral presentation skills and handling questions during talks, while highlighting influential figures in the field of AI communication.
How to write a research paper [from Peyton Jones / MSR]
Philip Resnik’s writing advice
Must-read style advice
A short guide on typesetting math
Have an organized clean bibliography
Rebuttals: How we write rebuttals by Devi Parikh
Clip from session
Paths to Graduate Studies, with Bryan M. Li, Winnie Xu, Gbemileke Onilude and Emma Strubell
This conversation explores the diverse journeys of individuals into machine learning research, emphasizing the importance of mentorship, the decision-making process for graduate school, and strategies for building a strong research profile. Panelists share their experiences with the Cohere Labs Research Scholar Program, discuss how to choose research topics, and provide insights into navigating the graduate school application process. The discussion also addresses common concerns and questions from aspiring researchers.
Clip from session
Applying to Research Roles in Industry, with Ahmet Üstün, Laura Ruis, and Cate Ciugureanu
This conversation explores the nuances of applying for research roles in the industry, contrasting it with academia. The panelists discuss their motivations for choosing industry, the essential skills required for machine learning research roles, and the importance of communication. They delve into the differences between industry and academia, provide tips on structuring applications, and share insights on interview preparation. The discussion also highlights common mistakes applicants make and offers advice on how to navigate failures during the application process. Finally, the panelists share their final thoughts on pursuing a career in research, emphasizing the importance of passion and networking.
Clip from session
Mentorship in ML Research, with Pablo Samuel Castro, Esra'a Saleh and Viraat Aryabumi.
This conversation explores the multifaceted nature of mentorship in research, particularly in the field of machine learning. Panelists share their personal experiences as both mentors and mentees, emphasizing the importance of seeking guidance, being prepared for mentorship interactions, and the organic nature of mentorship relationships. They discuss the value of informal mentorship, the timing for seeking mentorship, and the benefits of becoming a mentor. The discussion culminates in practical advice for early career researchers and the significance of kindness and openness in professional relationships.
Clip from session
When life happens: How to navigate challenging times in research? with Marzieh Fadaee, Giuseppe Castellucci and Sowmya Vajjala
This panel discussion focuses on the challenges faced by researchers in AI and NLP, particularly in navigating cultural transitions, balancing life in academia versus industry, and adapting to the rapid changes brought by large language models. The panelists share their personal experiences and insights on how to thrive in these environments, emphasizing the importance of community, mentorship, and adaptability in research careers.
Cohere LLM University to learn more about LLMs and Transformers!
Andrej Karpathy Youtube Channel to learn how to build LLMs from first principles
Fast.ai contains courses on Deep Learning and other AI related topics
Sebastian Raschka is a machine learning & AI researcher and programmer with lots of interesting blog posts
We invited members of the community to contribute to GOLD: Great Old List of Datasets.
We are happy to share GOLD publicly with our open science community as a comprehensive (and ever-growing) list of NLP datasets in all languages. Our hope is that you will make use of it to inform your own research. As a collaborative document, we continue to invite you to propose edits and additions to the document to support your own work and that of fellow community members.