#206 – Ishan Misra: Self-Supervised Deep Learning in Computer Vision

Ishan Misra is a research scientist at FAIR working on self-supervised visual learning. Please support this podcast by checking out our sponsors:
– Onnit: https://lexfridman.com/onnit to get up to 10% off
– The Information: https://theinformation.com/lex to get 75% off first month
– Grammarly: https://grammarly.com/lex to get 20% off premium
– Athletic Greens: https://athleticgreens.com/lex and use code LEX to get 1 month of fish oil

EPISODE LINKS:
Ishan’s twitter: https://twitter.com/imisra_
Ishan’s website: https://imisra.github.io
Ishan’s FAIR page: https://ai.facebook.com/people/ishan-misra/

PODCAST INFO:
Podcast website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
YouTube Full Episodes: https://youtube.com/lexfridman
YouTube Clips: https://youtube.com/lexclips

SUPPORT & CONNECT:
– Check out the sponsors above, it’s the best way to support this podcast
– Support on Patreon: https://www.patreon.com/lexfridman
– Twitter: https://twitter.com/lexfridman
– Instagram: https://www.instagram.com/lexfridman
– LinkedIn: https://www.linkedin.com/in/lexfridman
– Facebook: https://www.facebook.com/lexfridman
– Medium: https://medium.com/@lexfridman

OUTLINE:
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.
(00:00)– Introduction
(07:49)– Self-supervised learning
(16:24)– Self-supervised learning is the dark matter of intelligence
(20:17)– Categorization
(28:50)– Is computer vision still really hard?
(32:35)– Understanding Language
(42:14)– Harder to solve: vision or language
(48:59)– Contrastive learning & energy-based models
(52:59)– Data augmentation
(57:19)– Fixed audio spike by lowering sound with pen tool
(1:05:33)– Real data vs. augmented data
(1:09:16)– Non-contrastive learning energy based self supervised learning methods
(1:12:54)– Unsupervised learning (SwAV)
(1:15:37)– Self-supervised Pretraining (SEER)
(1:20:44)– Self-supervised learning (SSL) architectures
(1:26:43)– VISSL pytorch-based SSL library
(1:29:38)– Multi-modal
(1:37:06)– Active learning
(1:42:45)– Autonomous driving
(1:54:12)– Limits of deep learning
(1:58:19)– Difference between learning and reasoning
(2:03:26)– Building super-human AI
(2:11:14)– Most beautiful idea in self-supervised learning
(2:15:02)– Simulation for training AI
(2:18:27)– Video games replacing reality
(2:19:40)– How to write a good research paper
(2:24:08)– Best programming language for beginners
(2:25:01)– PyTorch vs TensorFlow
(2:28:26)– Advice for getting into machine learning
(2:30:31)– Advice for young people
(2:32:58)– Meaning of life