Deep Learning without Poor Local Minima Kawaguchi, Kenji In this paper, we prove a conjecture published in 1989 and also partially address an open problem announced at the Conference on Learning Theory (COLT) 2015. For an expected loss function of a deep nonlinear neural network, we prove the following statements under the independence assumption adopted from recent work: 1) the function is non-convex and non-concave, 2) every local minimum is a global minimum, 3) every critical point that is not a global minimum is a saddle point, and 4) the property of saddle points differs for shallow networks (with three layers) and deeper networks (with more than three layers). Moreover, we prove that the same four statements hold for deep linear neural networks with any depth, any widths and no unrealistic assumptions. As a result, we present an instance, for which we can answer to the following question: how difficult to directly train a deep model in theory? It is more difficult than the classical machine learning models (because of the non-convexity), but not too difficult (because of the nonexistence of poor local minima and the property of the saddle points). We note that even though we have advanced the theoretical foundations of deep learning, there is still a gap between theory and practice.
from Computer Science and Artificial Intelligence Lab (CSAIL) http://ift.tt/1Z2DjrM
jeudi 26 mai 2016
Deep Learning without Poor Local Minima
mercredi 25 mai 2016
Tail use improves soft substrate performance in models of early vertebrate land locomotors
Tail use improves soft substrate performance in models of early vertebrate land locomotors McInroe, Benjamin; Astley, Henry C.; Gong, Chaohui; Kawano, Sandy M.; Schiebel, Perrin E.; Rieser, Jennifer M.; Choset, Howie; Blob, Richard W.; Goldman, Daniel I. In the evolutionary transition from an aquatic to a terrestrial environment, ancient vertebrates (e.g. early tetrapods) faced the challenges of terrestrial locomotion on flowable substrates (e.g. sand and mud) of variable stiffness and incline. While morphology and ranges of motion of appendages can be revealed in fossils, biological and robophysical studies of modern taxa demonstrate that movement on such substrates can be sensitive to small changes in appendage use. Using a biological model (the mudskipper), a physical model (a robot), granular drag measurements, and theoretical tools from geometric mechanics, we demonstrate how tail use can improve robustness to variable limb use and substrate conditions. We hypothesize that properly coordinated tail movements may have provided a substantial benefit for the earliest vertebrates to move on land. Complete data and programs for the paper title above. Includes mudskipper data, robot control program, data and solidworks files, and simulation programs. Instructions are given in the appropriate subfolders of the data, and programs are commented.
from Theses online http://www.rssmix.com/
lundi 23 mai 2016
Network-centric peace: an application of network theory to violent conflicts.
Kramer, Reik (2014) Network-centric peace: an application of network theory to violent conflicts. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1s4y7t2
vendredi 20 mai 2016
Explaining risk-taking and risk-averse behaviours in peacemaking: a prospect theory reading of the AKP leadership’s behaviour vis-à-vis Cyprus and Armenia
Athanasios, Manis (2015) Explaining risk-taking and risk-averse behaviours in peacemaking: a prospect theory reading of the AKP leadership’s behaviour vis-à-vis Cyprus and Armenia. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1svpEz5
mercredi 18 mai 2016
The good soldier: dynamics of moral judgment among Israeli reserve soldiers and conscientious objectors within the context of the Israeli-Palestinian conflict
Baillie, Donna (2015) The good soldier: dynamics of moral judgment among Israeli reserve soldiers and conscientious objectors within the context of the Israeli-Palestinian conflict. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1YCiLpR
First women at the polls: examination of women’s early voting behaviour
Morgan-Collins, Mona (2016) First women at the polls: examination of women’s early voting behaviour. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1rTvfiw
mardi 17 mai 2016
Constructing public statistics: the history of the Argentine cost of living index, 1918-1943
Lanata Briones, Cecilia (2016) Constructing public statistics: the history of the Argentine cost of living index, 1918-1943. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/27vrOPx
Interest rates and financial market integration: a long-run perspective on China
Tang, Jian-Jing (2016) Interest rates and financial market integration: a long-run perspective on China. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1YysxcI
Labour tying arrangements: an enduring aspect of agrarian capitalism in India
Mohan, Taneesha (2015) Labour tying arrangements: an enduring aspect of agrarian capitalism in India. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1Xi3gEV
vendredi 13 mai 2016
Essays on the political economy of development
Martınez, Luis (2016) Essays on the political economy of development. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1VVAfjj
jeudi 12 mai 2016
The commercial development of Ancona, 1479-1551
Earle, Peter (1969) The commercial development of Ancona, 1479-1551. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1OlfGdk
The development of criminal law in Jamaica up to 1900
Edwards, Adolph (1968) The development of criminal law in Jamaica up to 1900. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1UVLAi3
mercredi 11 mai 2016
The Unbearable Lightness of Streaming
The Unbearable Lightness of Streaming Bennett, Charlie; Doshi, Ameet; Hagenmaier, Wendy; Rascoe, Fred Interview portion of Lost in the Stacks episode 303, broadcast May 06, 2016. Features interview with Fredrick Arnold of Future Oak Record Co.
from Theses online http://www.rssmix.com/
Hacking the web 2.0: user agency and the role of hackers as computational mediators
Rota, Andrea (2016) Hacking the web 2.0: user agency and the role of hackers as computational mediators. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1WpwItu
The growth of speculative building in Greece: modes of housing production and socioeconomic change, 1950-1974
Emmanuel, Dimitris (1981) The growth of speculative building in Greece: modes of housing production and socioeconomic change, 1950-1974. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/21WGUtf
Maori-Pakeha mixed marriages in New Zealand
Harre, John (1964) Maori-Pakeha mixed marriages in New Zealand. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1T4NYBW
The participant observer and groups in conflict: a case study from industry
Glendon, Ian (1977) The participant observer and groups in conflict: a case study from industry. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1rUn2KC
mardi 10 mai 2016
The decline of the Liberal Party 1880 - 1900
Rubinstein, B. David (1956) The decline of the Liberal Party 1880 - 1900. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1T39Bz7
lundi 9 mai 2016
The ethical life of Muslims in secular India: Islamic reformism in West Bengal
Pool, Fernande Wille-Wietske (2016) The ethical life of Muslims in secular India: Islamic reformism in West Bengal. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/277IigH
In search of power and credibility: essays on Chinese monetary history (1851-1945)
Yan, Xun (2015) In search of power and credibility: essays on Chinese monetary history (1851-1945). PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1rKEBwG
The democratic merits of partisanship: a comparative analysis of party member discourse in France and Hungary
Herman, Lise (2015) The democratic merits of partisanship: a comparative analysis of party member discourse in France and Hungary. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/277bJ2g
Four essays on eduction, caste and collective action in rural Pakistan
Channa, Anila (2015) Four essays on eduction, caste and collective action in rural Pakistan. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1WiLfah
The Welles of loneliness: Sumner Welles and the creation of American foreign policy
Parkes, Christopher (2015) The Welles of loneliness: Sumner Welles and the creation of American foreign policy. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1TOo2Jz
Global health, local realities: neglected diseases in northwestern Uganda
Pearson, Georgina (2015) Global health, local realities: neglected diseases in northwestern Uganda. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1T0kLV9
vendredi 6 mai 2016
Sexuality, gender, justice and law: rethinking normative heterosexuality and sexual justice from the perspectives of queer humanist men and masculinities studies
Wang, Chieh (2016) Sexuality, gender, justice and law: rethinking normative heterosexuality and sexual justice from the perspectives of queer humanist men and masculinities studies. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1rypE14
National parliamentary scrutiny of European Union affairs: explaining divergence of formal arrangements and actual activity
Hörner, Julian (2015) National parliamentary scrutiny of European Union affairs: explaining divergence of formal arrangements and actual activity. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1ryp0Ah
Hizbullah’s identity: Islam, nationalism and transnationalism
Hage Ali, Mohanad (2015) Hizbullah’s identity: Islam, nationalism and transnationalism. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1rypE0W
Designing technology to innovate teaching practices: a critical assessment of a learning design support environment
Pujadas, Roser (2015) Designing technology to innovate teaching practices: a critical assessment of a learning design support environment. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/24xVLQ7
Essays on campaign finance and political power
Fouirnaies, Alexander (2015) Essays on campaign finance and political power. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1YcYLKp
jeudi 5 mai 2016
Extreme insurance and the dynamics of risk
Maynard, Trevor (2016) Extreme insurance and the dynamics of risk. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1SPussZ
Information, social interactions and health seeking behavior
Derksen, Laura (2016) Information, social interactions and health seeking behavior. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1TpriZ0
Sovereign debt sustainability, financial repression, and monetary innovation: Britain and currency black markets in the mid-20th century
Hileman, Garrick (2015) Sovereign debt sustainability, financial repression, and monetary innovation: Britain and currency black markets in the mid-20th century. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1Zhg6Ss
mercredi 4 mai 2016
Partnership or partnerships? An assessment of China-EU relations between 2001 and 2013 with cases studies on their collaborations on climate change and renewable energy
Yu, Jie (2014) Partnership or partnerships? An assessment of China-EU relations between 2001 and 2013 with cases studies on their collaborations on climate change and renewable energy. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1rooIfg
Kin-states and kin majorities from the bottom-up: developing a model of nested integration in Crimea & Moldova
Knott, Eleanor (2015) Kin-states and kin majorities from the bottom-up: developing a model of nested integration in Crimea & Moldova. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1Oe9pen
Essays in economics of education
De Philippis, Marta (2016) Essays in economics of education. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/26SOE3b
The principle of distinction and women in conflicts in Africa
Stern, Orly (2015) The principle of distinction and women in conflicts in Africa. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1SNbQGy
mardi 3 mai 2016
Essays on the macroeconomics of the great recession
Thwaites, Gregory (2016) Essays on the macroeconomics of the great recession. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1X6txWT
Expanding the Wahhabi mission: Saudi Arabia, the Islamic University of Medina and the transnational religious economy
Farquhar, Michael (2013) Expanding the Wahhabi mission: Saudi Arabia, the Islamic University of Medina and the transnational religious economy. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1SKOSQr
Migration with a mission: geographies of evangelical mission(aries) to post communist Albania
Brickell, Claire (2013) Migration with a mission: geographies of evangelical mission(aries) to post communist Albania. PhD thesis, The London School of Economics and Political Science (LSE).
from LSE Theses Online: No conditions. Results ordered -Date Deposited. http://ift.tt/1SKM6L3
