Theory of Machine Learning

RUB
INI
Research Groups
Theory of Machine Learning

The optimization of adaptive systems workgroup is concerned with the design and analysis of adaptive information processing systems. We are interested in systems that improve over time through learning, self-adaptation, and evolution. Our systems improve autonomously based on data, in contrast to manual instruction or programming.

Parameter tuning for a support vector machine

Currently we are working on

fast training and model selection for support vector machines
learning in deep networks
development of new evolutionary search algorithms and their analysis
open source implementation of a large number of machine learning algorithms

We offer theoretical and practical advice in machine learning and computational intelligence to other research groups and industrial partners.

Software: Shark

We provide and maintain a fast, modular, open source C++ library for the design and optimization of adaptive systems. It provides a diverse set of machine learning algorithms as well as methods for non-linear optimization. The Shark library works under SunOS/Linux, Mac OS X, and Windows. Shark can be downloaded from shark-ml.org.

Former Group Members

Group Leader

Prof. Dr. Tobias Glasmachers

Members

Sahar Qaadan, M.Sc.

Black Box Optimization Competition (BBComp)

Prof. Dr. Tobias Glasmachers

Dual Training of Non-linear Support-Vector-Machines on a Budget

Prof. Dr. Tobias Glasmachers

2019

Global Convergence of the (1+1) Evolution Strategy
Glasmachers, T.
Evolutionary Computation Journal (ECJ)

arXiv.org pdf

@article{Glasmachers2019, author = {Glasmachers, T.}, title = {Global Convergence of the (1+1) Evolution Strategy}, journal = {Evolutionary Computation Journal (ECJ)}, year = {2019}, }

Glasmachers, T. (2019). Global Convergence of the (1+1) Evolution Strategy. Evolutionary Computation Journal (ECJ).

2018

Drift Theory in Continuous Search Spaces: Expected Hitting Time of the (1+1)-ES with 1/5 Success Rule
Akimoto, Y., Auger, A., & Glasmachers, T.
In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO) ACM

link 1802.03209.pdf

@inproceedings{AkimotoAugerGlasmachers2018, author = {Akimoto, Youhei and Auger, Anne and Glasmachers, Tobias}, title = {Drift Theory in Continuous Search Spaces: Expected Hitting Time of the (1+1)-ES with 1/5 Success Rule}, booktitle = {Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)}, publisher = {ACM}, year = {2018}, }

Akimoto, Y., Auger, A., & Glasmachers, T.. (2018). Drift Theory in Continuous Search Spaces: Expected Hitting Time of the (1+1)-ES with 1/5 Success Rule. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO). ACM.
Challenges of Convex Quadratic Bi-objective Benchmark Problems
Glasmachers, T.
arXiv.org

arXiv.org

@techreport{Glasmachers2018, author = {Glasmachers, Tobias}, title = {Challenges of Convex Quadratic Bi-objective Benchmark Problems}, institution = {arXiv.org}, number = {arXiv:1810.09690}, year = {2018}, }

Glasmachers, T. (2018). Challenges of Convex Quadratic Bi-objective Benchmark Problems (No. arXiv:1810.09690). arXiv.org.
Speeding Up Budgeted Dual SVM Training with Precomputed GSS
Glasmachers, T., & Qaadan, S.
(M. M. -y-G. Ruben Vera-Rodriguez Sergio Velastin & Morales, A., Eds.), The 23rd Iberoamerican Congress on Pattern Recognition

@postproceedings{GlasmachersQaadan2018b, author = {Glasmachers, Tobias and Qaadan, Sahar}, title = {Speeding Up Budgeted Dual SVM Training with Precomputed GSS}, year = {2018}, }

Glasmachers, T., & Qaadan, S.. (2018). Speeding Up Budgeted Dual SVM Training with Precomputed GSS. (M. M. -y-G. Ruben Vera-Rodriguez Sergio Velastin & Morales, A., Eds.), The 23rd Iberoamerican Congress on Pattern Recognition.
Speeding Up Budgeted Stochastic Gradient Descent SVM Training with Precomputed Golden Section Search
Glasmachers, T., & Qaadan, S.
In G. Nicosia, Pardalos, P., Giuffrida, G., Umeton, R., & Sciacca, V. (Eds.), The 4th International Conference on machine Learning, Optimization and Data science - LOD 2018

link

@inproceedings{GlasmachersQaadan2018, author = {Glasmachers, Tobias and Qaadan, Sahar}, title = {Speeding Up Budgeted Stochastic Gradient Descent SVM Training with Precomputed Golden Section Search}, booktitle = {The 4th International Conference on machine Learning, Optimization and Data science - LOD 2018}, editor = {Nicosia, Giuseppe and Pardalos, Panos and Giuffrida, Giovanni and Umeton, Renato and Sciacca, Vincenzo}, year = {2018}, }

Glasmachers, T., & Qaadan, S.. (2018). Speeding Up Budgeted Stochastic Gradient Descent SVM Training with Precomputed Golden Section Search. In G. Nicosia, Pardalos, P., Giuffrida, G., Umeton, R., & Sciacca, V. (Eds.), The 4th International Conference on machine Learning, Optimization and Data science - LOD 2018.
Large Scale Black-box Optimization by Limited-Memory Matrix Adaptation
Loshchilov, I., Glasmachers, T., & Beyer, H. -G.
IEEE Transactions on Evolutionary Computation, 99

link link

@article{LoshchilovGlasmachersBeyer2018, author = {Loshchilov, Ilya and Glasmachers, Tobias and Beyer, Hans-Georg}, title = {Large Scale Black-box Optimization by Limited-Memory Matrix Adaptation}, journal = {IEEE Transactions on Evolutionary Computation}, volume = {99}, year = {2018}, }

Loshchilov, I., Glasmachers, T., & Beyer, H. -G. (2018). Large Scale Black-box Optimization by Limited-Memory Matrix Adaptation. IEEE Transactions on Evolutionary Computation, 99.
Challenges in High-dimensional Controller Design with Evolution Strategies
Müller, N., & Glasmachers, T.
In Parallel Problem Solving from Nature (PPSN XVI) Springer

arXiv software

@inproceedings{MüllerGlasmachers2018, author = {Müller, Nils and Glasmachers, Tobias}, title = {Challenges in High-dimensional Controller Design with Evolution Strategies}, booktitle = {Parallel Problem Solving from Nature (PPSN XVI)}, publisher = {Springer}, year = {2018}, }

Müller, N., & Glasmachers, T.. (2018). Challenges in High-dimensional Controller Design with Evolution Strategies. In Parallel Problem Solving from Nature (PPSN XVI). Springer.
Multi-Merge Budget Maintenance for Stochastic Gradient Descent SVM Training
Qaadan, S., & Glasmachers, T.
arXiv.org

link

@techreport{QaadanGlasmachers2018, author = {Qaadan, Sahar and Glasmachers, Tobias}, title = {Multi-Merge Budget Maintenance for Stochastic Gradient Descent SVM Training}, institution = {arXiv.org}, number = {arXiv:1806.10179}, year = {2018}, }

Qaadan, S., & Glasmachers, T.. (2018). Multi-Merge Budget Maintenance for Stochastic Gradient Descent SVM Training (No. arXiv:1806.10179). arXiv.org.
Adaptive Multi-Merge Budget Maintenance for Stochastic Coordinate Ascent SVM Training
Qaadan, S., & Glasmachers, T.
Artificial Intelligence International Conference – A2IC 2018

@postproceedings{QaadanGlasmachers2018b, author = {Qaadan, Sahar and Glasmachers, Tobias}, title = {Adaptive Multi-Merge Budget Maintenance for Stochastic Coordinate Ascent SVM Training}, year = {2018}, }

Qaadan, S., & Glasmachers, T.. (2018). Adaptive Multi-Merge Budget Maintenance for Stochastic Coordinate Ascent SVM Training. Artificial Intelligence International Conference – A2IC 2018.

Dual SVM Training on a Budget

Qaadan, S., Schüler, M., & Glasmachers, T.

arXiv.org

@techreport{QaadanSchülerGlasmachers2018,
	author		=	{Qaadan, Sahar and Schüler, Merlin and Glasmachers, Tobias},
	title		=	{Dual SVM Training on a Budget},
	institution	=	{arXiv.org},
	number		=	{arXiv:1806.10182},
	year		=	{2018},
}

User-Centered Development of a Pedestrian Assistance System Using End-to-End Learning
Qureshi, H. S., Glasmachers, T., & Wiczorek, R.
In 17th IEEE International Conference on Machine Learning and Applications (ICMLA) (pp. 808–813) IEEE

link

@inproceedings{QureshiGlasmachersWiczorek2018, author = {Qureshi, Hasham Shahid and Glasmachers, Tobias and Wiczorek, Rebecca}, title = {User-Centered Development of a Pedestrian Assistance System Using End-to-End Learning}, booktitle = {17th IEEE International Conference on Machine Learning and Applications (ICMLA)}, pages = {808–813}, organization = {IEEE}, year = {2018}, }

Qureshi, H. S., Glasmachers, T., & Wiczorek, R. (2018). User-Centered Development of a Pedestrian Assistance System Using End-to-End Learning. In 17th IEEE International Conference on Machine Learning and Applications (ICMLA) (pp. 808–813). IEEE.

Universal Spike Classifier

Saif-ur-Rehman, M., Lienkämper, R., Parpaley, Y., Wellmer, J., Liu, C., Lee, B., et al.

arXiv.org

@techreport{Saif-ur-RehmanLienkämperParpaleyEtAl2018,
	author		=	{Saif-ur-Rehman, Muhammad and Lienkämper, Robin and Parpaley, Yaroslav and Wellmer, Jörg and Liu, Charles and Lee, Brian and Kellis, Spencer and Andersen, Richard and Iossifidis, Ioannis and Glasmachers, Tobias and Klaes, Christian},
	title		=	{Universal Spike Classifier},
	institution	=	{arXiv.org},
	number		=	{1811.02923},
	year		=	{2018},
}

2017

A Fast Incremental BSP Tree Archive for Non-dominated Points
Glasmachers, T.
In Evolutionary Multi-Criterion Optimization (EMO) Springer

pdf code

@inproceedings{Glasmachers2017, author = {Glasmachers, T.}, title = {A Fast Incremental BSP Tree Archive for Non-dominated Points}, booktitle = {Evolutionary Multi-Criterion Optimization (EMO)}, publisher = {Springer}, year = {2017}, }

Glasmachers, T. (2017). A Fast Incremental BSP Tree Archive for Non-dominated Points. In Evolutionary Multi-Criterion Optimization (EMO). Springer.
Limits of End-to-End Learning
Glasmachers, T.
In Proceedings of the 9th Asian Conference on Machine Learning (ACML)

pdf code proceedings

@inproceedings{Glasmachers2017b, author = {Glasmachers, T.}, title = {Limits of End-to-End Learning}, booktitle = {Proceedings of the 9th Asian Conference on Machine Learning (ACML)}, year = {2017}, }

Glasmachers, T. (2017). Limits of End-to-End Learning. In Proceedings of the 9th Asian Conference on Machine Learning (ACML).
Texture attribute synthesis and transfer using feed-forward CNNs
Irmer, T., Glasmachers, T., & Maji, S.
In Winter Conference on Applications of Computer Vision (WACV) IEEE

pdf

@inproceedings{IrmerGlasmachersMaji2017, author = {Irmer, T. and Glasmachers, T. and Maji, S.}, title = {Texture attribute synthesis and transfer using feed-forward CNNs}, booktitle = {Winter Conference on Applications of Computer Vision (WACV)}, publisher = {IEEE}, year = {2017}, }

Irmer, T., Glasmachers, T., & Maji, S. (2017). Texture attribute synthesis and transfer using feed-forward CNNs. In Winter Conference on Applications of Computer Vision (WACV). IEEE.
Qualitative and Quantitative Assessment of Step Size Adaptation Rules
Krause, O., Glasmachers, T., & Igel, C.
In Conference on Foundations of Genetic Algorithms (FOGA) ACM

pdf

@inproceedings{KrauseGlasmachersIgel2017, author = {Krause, O. and Glasmachers, T. and Igel, C.}, title = {Qualitative and Quantitative Assessment of Step Size Adaptation Rules}, booktitle = {Conference on Foundations of Genetic Algorithms (FOGA)}, publisher = {ACM}, year = {2017}, }

Krause, O., Glasmachers, T., & Igel, C. (2017). Qualitative and Quantitative Assessment of Step Size Adaptation Rules. In Conference on Foundations of Genetic Algorithms (FOGA). ACM.

2016

Fast model selection by limiting SVM training times
Demircioğlu, A., Horn, D., Glasmachers, T., Bischl, B., & Weihs, C.
arxiv.org

pdf arXiv.org

@techreport{DemircioğluHornGlasmachersEtAl2016, author = {Demircioğlu, A. and Horn, D. and Glasmachers, T. and Bischl, B. and Weihs, C.}, title = {Fast model selection by limiting SVM training times}, institution = {arxiv.org}, number = {arxiv:1302.1602.03368v1}, year = {2016}, }

Demircioğlu, A., Horn, D., Glasmachers, T., Bischl, B., & Weihs, C. (2016). Fast model selection by limiting SVM training times (No. arxiv:1302.1602.03368v1). arxiv.org.
A Unified View on Multi-class Support Vector Classification
Doğan, Ü., Glasmachers, T., & Igel, C.
Journal of Machine Learning Research, 17(45), 1–32

pdf jmlr.org

@article{DoğanGlasmachersIgel2016, author = {Doğan, Ü. and Glasmachers, T. and Igel, C.}, title = {A Unified View on Multi-class Support Vector Classification}, journal = {Journal of Machine Learning Research}, volume = {17}, number = {45}, pages = {1–32}, year = {2016}, }

Doğan, Ü., Glasmachers, T., & Igel, C. (2016). A Unified View on Multi-class Support Vector Classification. Journal of Machine Learning Research, 17(45), 1–32.
Finite Sum Acceleration vs. Adaptive Learning Rates for the Training of Kernel Machines on a Budget
Glasmachers, T.
In NIPS workshop on Optimization for Machine Learning

pdf code

@inproceedings{Glasmachers2016, author = {Glasmachers, T.}, title = {Finite Sum Acceleration vs. Adaptive Learning Rates for the Training of Kernel Machines on a Budget}, booktitle = {NIPS workshop on Optimization for Machine Learning}, year = {2016}, }

Glasmachers, T. (2016). Finite Sum Acceleration vs. Adaptive Learning Rates for the Training of Kernel Machines on a Budget. In NIPS workshop on Optimization for Machine Learning.
Small Stochastic Average Gradient Steps
Glasmachers, T.
In NIPS workshop on Optimizing the Optimizers

pdf

@inproceedings{Glasmachers2016b, author = {Glasmachers, T.}, title = {Small Stochastic Average Gradient Steps}, booktitle = {NIPS workshop on Optimizing the Optimizers}, year = {2016}, }

Glasmachers, T. (2016). Small Stochastic Average Gradient Steps. In NIPS workshop on Optimizing the Optimizers.
A Comparative Study on Large Scale Kernelized Support Vector Machines
Horn, D., Demircioğlu, A., Bischl, B., Glasmachers, T., & Weihs, C.
Advances in Data Analysis and Classification (ADAC), 1–17

springer.com

@article{HornDemircioğluBischlEtAl2016, author = {Horn, D. and Demircioğlu, A. and Bischl, B. and Glasmachers, T. and Weihs, C.}, title = {A Comparative Study on Large Scale Kernelized Support Vector Machines}, journal = {Advances in Data Analysis and Classification (ADAC)}, pages = {1–17}, year = {2016}, }

Horn, D., Demircioğlu, A., Bischl, B., Glasmachers, T., & Weihs, C. (2016). A Comparative Study on Large Scale Kernelized Support Vector Machines. Advances in Data Analysis and Classification (ADAC), 1–17.
Unbounded Population MO-CMA-ES for the Bi-Objective BBOB Test Suite
Krause, O., Glasmachers, T., Hansen, N., & Igel, C.
In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)

pdf

@inproceedings{KrauseGlasmachersHansenEtAl2016, author = {Krause, O. and Glasmachers, T. and Hansen, N. and Igel, C.}, title = {Unbounded Population MO-CMA-ES for the Bi-Objective BBOB Test Suite}, booktitle = {Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)}, year = {2016}, }

Krause, O., Glasmachers, T., Hansen, N., & Igel, C. (2016). Unbounded Population MO-CMA-ES for the Bi-Objective BBOB Test Suite. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO).
Multi-objective Optimization with Unbounded Solution Sets
Krause, O., Glasmachers, T., & Igel, C.
In NIPS workshop on Bayesian Optimization

pdf

@inproceedings{KrauseGlasmachersIgel2016, author = {Krause, O. and Glasmachers, T. and Igel, C.}, title = {Multi-objective Optimization with Unbounded Solution Sets}, booktitle = {NIPS workshop on Bayesian Optimization}, year = {2016}, }

Krause, O., Glasmachers, T., & Igel, C. (2016). Multi-objective Optimization with Unbounded Solution Sets. In NIPS workshop on Bayesian Optimization.
Anytime Bi-Objective Optimization with a Hybrid Multi-Objective CMA-ES (HMO-CMA-ES)
Loshchilov, I., & Glasmachers, T.
In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)

pdf

@inproceedings{LoshchilovGlasmachers2016, author = {Loshchilov, I. and Glasmachers, T.}, title = {Anytime Bi-Objective Optimization with a Hybrid Multi-Objective CMA-ES (HMO-CMA-ES)}, booktitle = {Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)}, year = {2016}, }

Loshchilov, I., & Glasmachers, T.. (2016). Anytime Bi-Objective Optimization with a Hybrid Multi-Objective CMA-ES (HMO-CMA-ES). In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO).
Supervised Classification
Weihs, C., & Glasmachers, T.
In C. Weihs, Jannach, D., Vatolkin, I., & Rudolph, G. (Eds.), Music Data Analysis: Foundations and Applications

@incollection{WeihsGlasmachers2016, author = {Weihs, C. and Glasmachers, T.}, title = {Supervised Classification}, booktitle = {Music Data Analysis: Foundations and Applications}, editor = {Weihs, C. and Jannach, D. and Vatolkin, I. and Rudolph, G.}, year = {2016}, }

Weihs, C., & Glasmachers, T.. (2016). Supervised Classification. In C. Weihs, Jannach, D., Vatolkin, I., & Rudolph, G. (Eds.), Music Data Analysis: Foundations and Applications.

2015

A CMA-ES with Multiplicative Covariance Matrix Updates
Krause, O., & Glasmachers, T.
In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)

pdf code

@inproceedings{KrauseGlasmachers2015, author = {Krause, O. and Glasmachers, T.}, title = {A CMA-ES with Multiplicative Covariance Matrix Updates}, booktitle = {Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)}, year = {2015}, }

Krause, O., & Glasmachers, T.. (2015). A CMA-ES with Multiplicative Covariance Matrix Updates. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO).

2014

Testing Hypotheses by Regularized Maximum Mean Discrepancy
Danafar, S., Rancoita, P. M. V., Glasmachers, T., Whittingstall, K., & Schmidhuber, J.
International Journal of Computer and Information Technology (IJCIT), 3(2)

pdf arXiv.org

@article{DanafarRancoitaGlasmachersEtAl2014, author = {Danafar, S. and Rancoita, P.M.V. and Glasmachers, T. and Whittingstall, K. and Schmidhuber, J.}, title = {Testing Hypotheses by Regularized Maximum Mean Discrepancy}, journal = {International Journal of Computer and Information Technology (IJCIT)}, volume = {3}, number = {2}, year = {2014}, }

Danafar, S., Rancoita, P. M. V., Glasmachers, T., Whittingstall, K., & Schmidhuber, J. (2014). Testing Hypotheses by Regularized Maximum Mean Discrepancy. International Journal of Computer and Information Technology (IJCIT), 3(2).
Handling Sharp Ridges with Local Supremum Transformations
Glasmachers, T.
In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)

pdf

@inproceedings{Glasmachers2014, author = {Glasmachers, T.}, title = {Handling Sharp Ridges with Local Supremum Transformations}, booktitle = {Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)}, year = {2014}, }

Glasmachers, T. (2014). Handling Sharp Ridges with Local Supremum Transformations. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO).
Optimized Approximation Sets for Low-dimensional Benchmark Pareto Fronts
Glasmachers, T.
In Parallel Problem Solving from Nature (PPSN) Springer

pdf code

@inproceedings{Glasmachers2014b, author = {Glasmachers, T.}, title = {Optimized Approximation Sets for Low-dimensional Benchmark Pareto Fronts}, booktitle = {Parallel Problem Solving from Nature (PPSN)}, publisher = {Springer}, year = {2014}, }

Glasmachers, T. (2014). Optimized Approximation Sets for Low-dimensional Benchmark Pareto Fronts. In Parallel Problem Solving from Nature (PPSN). Springer.
Start Small, Grow Big - Saving Multiobjective Function Evaluations
Glasmachers, T., Naujoks, B., & Rudolph, G.
In Parallel Problem Solving from Nature (PPSN) Springer

pdf

@inproceedings{GlasmachersNaujoksRudolph2014, author = {Glasmachers, T. and Naujoks, B. and Rudolph, G.}, title = {Start Small, Grow Big - Saving Multiobjective Function Evaluations}, booktitle = {Parallel Problem Solving from Nature (PPSN)}, publisher = {Springer}, year = {2014}, }

Glasmachers, T., Naujoks, B., & Rudolph, G. (2014). Start Small, Grow Big - Saving Multiobjective Function Evaluations. In Parallel Problem Solving from Nature (PPSN). Springer.
Natural Evolution Strategies
Wierstra, D., Schaul, T., Glasmachers, T., Sun, Y., Peters, J., & Schmidhuber, J.
Journal of Machine Learning Research, 15, 949–980

pdf jmlr.org

@article{WierstraSchaulGlasmachersEtAl2014, author = {Wierstra, D. and Schaul, T. and Glasmachers, T. and Sun, Y. and Peters, J. and Schmidhuber, J.}, title = {Natural Evolution Strategies}, journal = {Journal of Machine Learning Research}, volume = {15}, pages = {949–980}, year = {2014}, }

Wierstra, D., Schaul, T., Glasmachers, T., Sun, Y., Peters, J., & Schmidhuber, J. (2014). Natural Evolution Strategies. Journal of Machine Learning Research, 15, 949–980.

2013

A Natural Evolution Strategy with Asynchronous Strategy Updates
Glasmachers, T.
In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)

pdf code

@inproceedings{Glasmachers2013, author = {Glasmachers, T.}, title = {A Natural Evolution Strategy with Asynchronous Strategy Updates}, booktitle = {Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)}, year = {2013}, }

Glasmachers, T. (2013). A Natural Evolution Strategy with Asynchronous Strategy Updates. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO).

The Planning-ahead SMO Algorithm

Glasmachers, T.

arxiv.org

@techreport{Glasmachers2013b,
	author		=	{Glasmachers, T.},
	title		=	{The Planning-ahead SMO Algorithm},
	institution	=	{arxiv.org},
	number		=	{arxiv:1305.0423v1},
	year		=	{2013},
}

Accelerated Coordinate Descent with Adaptive Coordinate Frequencies
Glasmachers, T., & Doğan, Ü.
In Proceedings of the fifth Asian Conference on Machine Learning (ACML)

pdf jmlr.org code (LASSO) code (LibLinear)

@inproceedings{GlasmachersDoğan2013, author = {Glasmachers, T. and Doğan, Ü.}, title = {Accelerated Coordinate Descent with Adaptive Coordinate Frequencies}, booktitle = {Proceedings of the fifth Asian Conference on Machine Learning (ACML)}, year = {2013}, }

Glasmachers, T., & Doğan, Ü. (2013). Accelerated Coordinate Descent with Adaptive Coordinate Frequencies. In Proceedings of the fifth Asian Conference on Machine Learning (ACML).
Approximation properties of DBNs with binary hidden units and real-valued visible units
Krause, O., Fischer, A., Glasmachers, T., & Igel, C.
In Proceedings of the International Conference on Machine Learning (ICML)

pdf

@inproceedings{KrauseFischerGlasmachersEtAl2013, author = {Krause, O. and Fischer, A. and Glasmachers, T. and Igel, C.}, title = {Approximation properties of DBNs with binary hidden units and real-valued visible units}, booktitle = {Proceedings of the International Conference on Machine Learning (ICML)}, year = {2013}, }

Krause, O., Fischer, A., Glasmachers, T., & Igel, C. (2013). Approximation properties of DBNs with binary hidden units and real-valued visible units. In Proceedings of the International Conference on Machine Learning (ICML).

2012

Turning Binary Large-margin Bounds into Multi-class Bounds
Doğan, Ü., Glasmachers, T., & Igel, C.
In ICML workshop on RKHS and kernel-based methods

pdf

@inproceedings{DoğanGlasmachersIgel2012, author = {Doğan, Ü. and Glasmachers, T. and Igel, C.}, title = {Turning Binary Large-margin Bounds into Multi-class Bounds}, booktitle = {ICML workshop on RKHS and kernel-based methods}, year = {2012}, }

Doğan, Ü., Glasmachers, T., & Igel, C. (2012). Turning Binary Large-margin Bounds into Multi-class Bounds. In ICML workshop on RKHS and kernel-based methods.
A Note on Extending Generalization Bounds for Binary Large-margin Classifiers to Multiple Classes
Doğan, Ü., Glasmachers, T., & Igel, C.
In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases (ECML-PKDD)

pdf

@inproceedings{DoğanGlasmachersIgel2012b, author = {Doğan, Ü. and Glasmachers, T. and Igel, C.}, title = {A Note on Extending Generalization Bounds for Binary Large-margin Classifiers to Multiple Classes}, booktitle = {Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases (ECML-PKDD)}, year = {2012}, }

Doğan, Ü., Glasmachers, T., & Igel, C. (2012). A Note on Extending Generalization Bounds for Binary Large-margin Classifiers to Multiple Classes. In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases (ECML-PKDD).
Convergence of the IGO-Flow of Isotropic Gaussian Distributions on Convex Quadratic Problems
Glasmachers, T.
In C. C. Coello, Cutello, V., Deb, K., Forrest, S., Nicosia, G., & Pavone, M. (Eds.), Parallel Problem Solving from Nature (PPSN) Springer

pdf

@inproceedings{Glasmachers2012, author = {Glasmachers, T.}, title = {Convergence of the IGO-Flow of Isotropic Gaussian Distributions on Convex Quadratic Problems}, booktitle = {Parallel Problem Solving from Nature (PPSN)}, editor = {Coello, C. Coello and Cutello, V. and Deb, K. and Forrest, S. and Nicosia, G. and Pavone, M.}, publisher = {Springer}, year = {2012}, }

Glasmachers, T. (2012). Convergence of the IGO-Flow of Isotropic Gaussian Distributions on Convex Quadratic Problems. In C. C. Coello, Cutello, V., Deb, K., Forrest, S., Nicosia, G., & Pavone, M. (Eds.), Parallel Problem Solving from Nature (PPSN). Springer.
Kernel Representations for Evolving Continuous Functions
Glasmachers, T., Koutník, J., & Schmidhuber, J.
Journal of Evolutionary Intelligence, 5(3), 171–187

pdf

@article{GlasmachersKoutníkSchmidhuber2012, author = {Glasmachers, T. and Koutník, J. and Schmidhuber, J.}, title = {Kernel Representations for Evolving Continuous Functions}, journal = {Journal of Evolutionary Intelligence}, volume = {5}, number = {3}, pages = {171–187}, year = {2012}, doi = {10.1007/s12065-012-0070-y}, }

Glasmachers, T., Koutník, J., & Schmidhuber, J. (2012). Kernel Representations for Evolving Continuous Functions. Journal of Evolutionary Intelligence, 5(3), 171–187. http://doi.org/10.1007/s12065-012-0070-y

2011

Novelty Restarts for Evolution Strategies
Cuccu, G., Gomez, F., & Glasmachers, T.
In Proceedings of the IEEE Congress on Evolutionary Computation (CEC) IEEE

pdf

@inproceedings{CuccuGomezGlasmachers2011, author = {Cuccu, G. and Gomez, F. and Glasmachers, T.}, title = {Novelty Restarts for Evolution Strategies}, booktitle = {Proceedings of the IEEE Congress on Evolutionary Computation (CEC)}, publisher = {IEEE}, year = {2011}, }

Cuccu, G., Gomez, F., & Glasmachers, T.. (2011). Novelty Restarts for Evolution Strategies. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC). IEEE.
Optimal Direct Policy Search
Glasmachers, T., & Schmidhuber, J.
In Proceedings of the 4th Conference on Artificial General Intelligence (AGI)

pdf

@inproceedings{GlasmachersSchmidhuber2011, author = {Glasmachers, T. and Schmidhuber, J.}, title = {Optimal Direct Policy Search}, booktitle = {Proceedings of the 4th Conference on Artificial General Intelligence (AGI)}, year = {2011}, }

Glasmachers, T., & Schmidhuber, J. (2011). Optimal Direct Policy Search. In Proceedings of the 4th Conference on Artificial General Intelligence (AGI).
Artificial Curiosity for Autonomous Space Exploration
Graziano, V., Glasmachers, T., Schaul, T., Pape, L., Cuccu, G., Leitner, J., & Schmidhuber, J.
ACTA FUTURA

pdf

@article{GrazianoGlasmachersSchaulEtAl2011, author = {Graziano, V. and Glasmachers, T. and Schaul, T. and Pape, L. and Cuccu, G. and Leitner, J. and Schmidhuber, J.}, title = {Artificial Curiosity for Autonomous Space Exploration}, journal = {ACTA FUTURA}, year = {2011}, }

Graziano, V., Glasmachers, T., Schaul, T., Pape, L., Cuccu, G., Leitner, J., & Schmidhuber, J. (2011). Artificial Curiosity for Autonomous Space Exploration. ACTA FUTURA.
High Dimensions and Heavy Tails for Natural Evolution Strategies
Schaul, T., Glasmachers, T., & Schmidhuber, J.
In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)

pdf

@inproceedings{SchaulGlasmachersSchmidhuber2011, author = {Schaul, T. and Glasmachers, T. and Schmidhuber, J.}, title = {High Dimensions and Heavy Tails for Natural Evolution Strategies}, booktitle = {Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)}, year = {2011}, }

Schaul, T., Glasmachers, T., & Schmidhuber, J. (2011). High Dimensions and Heavy Tails for Natural Evolution Strategies. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO).
Coherence Progress: A Measure of Interestingness Based on Fixed Compressors
Schaul, T., Pape, L., Glasmachers, T., Graziano, V., & Schmidhuber, J.
In Proceedings of the 4th Conference on Artificial General Intelligence (AGI)

pdf

@inproceedings{SchaulPapeGlasmachersEtAl2011, author = {Schaul, T. and Pape, L. and Glasmachers, T. and Graziano, V. and Schmidhuber, J.}, title = {Coherence Progress: A Measure of Interestingness Based on Fixed Compressors}, booktitle = {Proceedings of the 4th Conference on Artificial General Intelligence (AGI)}, year = {2011}, }

Schaul, T., Pape, L., Glasmachers, T., Graziano, V., & Schmidhuber, J. (2011). Coherence Progress: A Measure of Interestingness Based on Fixed Compressors. In Proceedings of the 4th Conference on Artificial General Intelligence (AGI).

2010

Universal Consistency of Multi-Class Support Vector Classification
Glasmachers, T.
In Advances in Neural Information Processing Systems (NIPS)

pdf

@inproceedings{Glasmachers2010, author = {Glasmachers, T.}, title = {Universal Consistency of Multi-Class Support Vector Classification}, booktitle = {Advances in Neural Information Processing Systems (NIPS)}, year = {2010}, }

Glasmachers, T. (2010). Universal Consistency of Multi-Class Support Vector Classification. In Advances in Neural Information Processing Systems (NIPS).
Maximum Likelihood Model Selection for 1-Norm Soft Margin SVMs with Multiple Parameters
Glasmachers, T., & Igel, C.
IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(8), 1522–1528

pdf

@article{GlasmachersIgel2010, author = {Glasmachers, T. and Igel, C.}, title = {Maximum Likelihood Model Selection for 1-Norm Soft Margin SVMs with Multiple Parameters}, journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence}, volume = {32}, number = {8}, pages = {1522–1528}, year = {2010}, }

Glasmachers, T., & Igel, C. (2010). Maximum Likelihood Model Selection for 1-Norm Soft Margin SVMs with Multiple Parameters. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(8), 1522–1528.
A Natural Evolution Strategy for Multi-Objective Optimization
Glasmachers, T., Schaul, T., & Schmidhuber, J.
In Parallel Problem Solving from Nature (PPSN) Springer

pdf

@inproceedings{GlasmachersSchaulSchmidhuber2010, author = {Glasmachers, T. and Schaul, T. and Schmidhuber, J.}, title = {A Natural Evolution Strategy for Multi-Objective Optimization}, booktitle = {Parallel Problem Solving from Nature (PPSN)}, publisher = {Springer}, year = {2010}, }

Glasmachers, T., Schaul, T., & Schmidhuber, J. (2010). A Natural Evolution Strategy for Multi-Objective Optimization. In Parallel Problem Solving from Nature (PPSN). Springer.
Exponential Natural Evolution Strategies
Glasmachers, T., Schaul, T., Sun, Y., Wierstra, D., & Schmidhuber, J.
In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)

pdf

@inproceedings{GlasmachersSchaulSunEtAl2010, author = {Glasmachers, T. and Schaul, T. and Sun, Y. and Wierstra, D. and Schmidhuber, J.}, title = {Exponential Natural Evolution Strategies}, booktitle = {Proceedings of the Genetic and Evolutionary Computation Conference (GECCO)}, year = {2010}, }

Glasmachers, T., Schaul, T., Sun, Y., Wierstra, D., & Schmidhuber, J. (2010). Exponential Natural Evolution Strategies. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO).
Frontier Search
Sun, Y., Glasmachers, T., Schaul, T., & Schmidhuber, J.
In Proceedings of the 3rd Conference on Artificial General Intelligence (AGI)

pdf

@inproceedings{SunGlasmachersSchaulEtAl2010, author = {Sun, Y. and Glasmachers, T. and Schaul, T. and Schmidhuber, J.}, title = {Frontier Search}, booktitle = {Proceedings of the 3rd Conference on Artificial General Intelligence (AGI)}, year = {2010}, }

Sun, Y., Glasmachers, T., Schaul, T., & Schmidhuber, J. (2010). Frontier Search. In Proceedings of the 3rd Conference on Artificial General Intelligence (AGI).

2008

On related violating pairs for working set selection in SMO algorithms
Glasmachers, T.
In M. Verleysen (Ed.), Proceedings of the 16th European Symposium on Artificial Neural Networks (ESANN) d-side publications

pdf

@inproceedings{Glasmachers2008, author = {Glasmachers, T.}, title = {On related violating pairs for working set selection in SMO algorithms}, booktitle = {Proceedings of the 16th European Symposium on Artificial Neural Networks (ESANN)}, editor = {Verleysen, M.}, publisher = {d-side publications}, year = {2008}, }

Glasmachers, T. (2008). On related violating pairs for working set selection in SMO algorithms. In M. Verleysen (Ed.), Proceedings of the 16th European Symposium on Artificial Neural Networks (ESANN). d-side publications.
Gradient Based Optimization of Support Vector Machines
Glasmachers, T.
Doctoral thesis, Fakultät für Mathematik, Ruhr-Universität Bochum, Germany

pdf

@phdthesis{Glasmachers2008b, author = {Glasmachers, T.}, title = {Gradient Based Optimization of Support Vector Machines}, school = {Fakultät für Mathematik, Ruhr-Universität Bochum, Germany}, year = {2008}, }

Glasmachers, T. (2008). Gradient Based Optimization of Support Vector Machines. Doctoral thesis, Fakultät für Mathematik, Ruhr-Universität Bochum, Germany.
Second-Order SMO Improves SVM Online and Active Learning
Glasmachers, T., & Igel, C.
Neural Computation, 20(2), 374–382

pdf

@article{GlasmachersIgel2008, author = {Glasmachers, T. and Igel, C.}, title = {Second-Order SMO Improves SVM Online and Active Learning}, journal = {Neural Computation}, volume = {20}, number = {2}, pages = {374–382}, year = {2008}, }

Glasmachers, T., & Igel, C. (2008). Second-Order SMO Improves SVM Online and Active Learning. Neural Computation, 20(2), 374–382.
Uncertainty Handling in Model Selection for Support Vector Machines
Glasmachers, T., & Igel, C.
In G. Rudolph, Jansen, T., Lucas, S., Poloni, C., & Beume, N. (Eds.), Parallel Problem Solving from Nature (PPSN) (pp. 185–194) Springer

pdf

@inproceedings{GlasmachersIgel2008b, author = {Glasmachers, T. and Igel, C.}, title = {Uncertainty Handling in Model Selection for Support Vector Machines}, booktitle = {Parallel Problem Solving from Nature (PPSN)}, editor = {Rudolph, G. and Jansen, T. and Lucas, S. and Poloni, C. and Beume, N.}, pages = {185–194}, publisher = {Springer}, year = {2008}, }

Glasmachers, T., & Igel, C. (2008). Uncertainty Handling in Model Selection for Support Vector Machines. In G. Rudolph, Jansen, T., Lucas, S., Poloni, C., & Beume, N. (Eds.), Parallel Problem Solving from Nature (PPSN) (pp. 185–194). Springer.
Shark
Igel, C., Heidrich-Meisner, V., & Glasmachers, T.
Journal of Machine Learning Research, 9, 993–996

pdf jmlr.org

@article{IgelHeidrich-MeisnerGlasmachers2008, author = {Igel, C. and Heidrich-Meisner, V. and Glasmachers, T.}, title = {Shark}, journal = {Journal of Machine Learning Research}, volume = {9}, pages = {993–996}, year = {2008}, }

Igel, C., Heidrich-Meisner, V., & Glasmachers, T.. (2008). Shark. Journal of Machine Learning Research, 9, 993–996.

2007

Gradient-Based Optimization of Kernel-Target Alignment for Sequence Kernels Applied to Bacterial Gene Start Detection
Igel, C., Glasmachers, T., Mersch, B., Pfeifer, N., & Meinicke, P.
IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB), 4(2), 216–226

pdf

@article{IgelGlasmachersMerschEtAl2007, author = {Igel, C. and Glasmachers, T. and Mersch, B. and Pfeifer, N. and Meinicke, P.}, title = {Gradient-Based Optimization of Kernel-Target Alignment for Sequence Kernels Applied to Bacterial Gene Start Detection}, journal = {IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)}, volume = {4}, number = {2}, pages = {216–226}, year = {2007}, }

Igel, C., Glasmachers, T., Mersch, B., Pfeifer, N., & Meinicke, P. (2007). Gradient-Based Optimization of Kernel-Target Alignment for Sequence Kernels Applied to Bacterial Gene Start Detection. IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB), 4(2), 216–226.
Evolutionary Optimization of Sequence Kernels for Detection of Bacterial Gene Starts
Mersch, B., Glasmachers, T., Meinicke, P., & Igel, C.
International Journal of Neural Systems, 17(5), 369–381

pdf

@article{MerschGlasmachersMeinickeEtAl2007, author = {Mersch, B. and Glasmachers, T. and Meinicke, P. and Igel, C.}, title = {Evolutionary Optimization of Sequence Kernels for Detection of Bacterial Gene Starts}, journal = {International Journal of Neural Systems}, volume = {17}, number = {5}, pages = {369–381}, year = {2007}, }

Mersch, B., Glasmachers, T., Meinicke, P., & Igel, C. (2007). Evolutionary Optimization of Sequence Kernels for Detection of Bacterial Gene Starts. International Journal of Neural Systems, 17(5), 369–381.

2006

Degeneracy in Model Selection for SVMs with Radial Gaussian Kernel
Glasmachers, T.
In M. Verleysen (Ed.), Proceedings of the 14th European Symposium on Artificial Neural Networks (ESANN) d-side publications

pdf

@inproceedings{Glasmachers2006, author = {Glasmachers, T.}, title = {Degeneracy in Model Selection for SVMs with Radial Gaussian Kernel}, booktitle = {Proceedings of the 14th European Symposium on Artificial Neural Networks (ESANN)}, editor = {Verleysen, M.}, publisher = {d-side publications}, year = {2006}, }

Glasmachers, T. (2006). Degeneracy in Model Selection for SVMs with Radial Gaussian Kernel. In M. Verleysen (Ed.), Proceedings of the 14th European Symposium on Artificial Neural Networks (ESANN). d-side publications.
Maximum-Gain Working Set Selection for Support Vector Machines
Glasmachers, T., & Igel, C.
Journal of Machine Learning Research, 7, 1437–1466

pdf jmlr.org

@article{GlasmachersIgel2006, author = {Glasmachers, T. and Igel, C.}, title = {Maximum-Gain Working Set Selection for Support Vector Machines}, journal = {Journal of Machine Learning Research}, volume = {7}, pages = {1437–1466}, year = {2006}, }

Glasmachers, T., & Igel, C. (2006). Maximum-Gain Working Set Selection for Support Vector Machines. Journal of Machine Learning Research, 7, 1437–1466.
Evolutionary Optimization of Sequence Kernels for Detection of Bacterial Gene Starts
Mersch, B., Glasmachers, T., Meinicke, P., & Igel, C.
In Proceedings of the 16th International Conference on Artificial Neural Networks (ICANN) Springer-Verlag

pdf

@inproceedings{MerschGlasmachersMeinickeEtAl2006, author = {Mersch, B. and Glasmachers, T. and Meinicke, P. and Igel, C.}, title = {Evolutionary Optimization of Sequence Kernels for Detection of Bacterial Gene Starts}, booktitle = {Proceedings of the 16th International Conference on Artificial Neural Networks (ICANN)}, publisher = {Springer-Verlag}, year = {2006}, }

Mersch, B., Glasmachers, T., Meinicke, P., & Igel, C. (2006). Evolutionary Optimization of Sequence Kernels for Detection of Bacterial Gene Starts. In Proceedings of the 16th International Conference on Artificial Neural Networks (ICANN). Springer-Verlag.

2005

Gradient-based Adaptation of General Gaussian Kernels
Glasmachers, T., & Igel, C.
Neural Computation, 17(10), 2099–2105

pdf

@article{GlasmachersIgel2005, author = {Glasmachers, T. and Igel, C.}, title = {Gradient-based Adaptation of General Gaussian Kernels}, journal = {Neural Computation}, volume = {17}, number = {10}, pages = {2099–2105}, year = {2005}, }

Glasmachers, T., & Igel, C. (2005). Gradient-based Adaptation of General Gaussian Kernels. Neural Computation, 17(10), 2099–2105.

Masters theses in the areas of machine learning and optimization

Prof. Dr. Tobias Glasmachers

I am regularly offering master's thesis topics in the areas of machine learning and evolutionary and gradient-based optimization.

Master Thesis

About the INI

The Institut für Neuroinformatik (INI) is a central research unit of the Ruhr-Universität Bochum. We aim to understand the fundamental principles through which organisms generate behavior and cognition while linked to their environments through sensory systems and while acting in those environments through effector systems. Inspired by our insights into such natural cognitive systems, we seek new solutions to problems of information processing in artificial cognitive systems. We draw from a variety of disciplines that include experimental approaches from psychology and neurophysiology as well as theoretical approaches from physics, mathematics, electrical engineering and applied computer science.

Contact

Universitätsstr. 150, Building NB, Room 3/32
D-44801 Bochum, Germany

Tel: (+49) 234 32-28967
Fax: (+49) 234 32-14210

sekretariat@ini.rub.de
www.ini.rub.de