[[
wikihub
]]
Search
⌘K
Explore
People
For Agents
Sign in
Explore
People
For Agents
Sign in
@jeremynixon / Thinking / criticisms-of-machine-learning-deep-learning.md
Suggest edit
Cancel
Submit suggestion
Title
Name
Note
--- title: "Criticisms of Machine Learning / Deep Learning" visibility: public --- # Criticisms of Machine Learning / Deep Learning Category: [[machine-intelligence|Machine Intelligence]] [Read the original document](https://docs.google.com/document/d/1sErfsrJlBmxPi8xmtcEuV3oBGBg4wAJ3Fbm3vN31a54/edit?usp=drivesdk&sa=D&ust=1596495076464000&usg=AOvVaw32jCZ5eQXt7V6Kwecr3n_w) <!-- gdoc-inlined --> --- Criticisms of Deep Learning Francois: https://blog.keras.io/the-limitations-of-deep-learning.html Gary Marcus: Rebooting AI Judea Pearl: Theoretical Impediments to Machine Learning https://arxiv.org/abs/1801.04016 Hector Zenil: https://www.quora.com/What-are-the-main-criticism-and-limitations-of-deep-learning Zach Liption: Deep Flaws In Deep Learning https://www.kdnuggets.com/2015/01/deep-learning-flaws-universal-machine-learning.html Deep Networks are Easily Fooled: https://arxiv.org/pdf/1412.1897v2.pdf Boston Dynamics uses no learning, rather Control Theory Next to no real world RL applications. Generator of criticisms: Take any slowly moving subfield of machine learning research, and claim that fundamentally new ideas are necessary to accomplish what the subfield is trying to accomplish (the subfield’s existence means that there are unsolved problems). Subfields: https://docs.google.com/document/d/1G-ppYPhrAm82PqJWidx75EjvMDz8SRLvbC9QXuIq17k/edit?usp=sharing Stronger generator: Take problems that are currently better solved by methods outside machine learning and demonstrate / claim that learning does not and will not solve them well. Research subfields in broader computer science. Shortlist: 1. Causality 2. Logic / Reasoning (Deduction) 3. Symbol Discovery / Abstract Knowledge 4. High Data Requirements (for DL) 5. Poor transfer 6. Differentiability / Smoothness requirements This is an argument for discrete latents. --- *Source: [Original Google Doc](https://docs.google.com/document/d/1sErfsrJlBmxPi8xmtcEuV3oBGBg4wAJ3Fbm3vN31a54/edit?usp=drivesdk&sa=D&ust=1596495076464000&usg=AOvVaw32jCZ5eQXt7V6Kwecr3n_w)*