Calgary ML Lab

The Calgary Machine Learning Lab is a research group led by Yani Ioannou within the Schulich School of Engineering at the University of Calgary. The lab has a research focus on improving Deep Neural Network (DNN) training and models, in particular for computer vision applications. Topics of research include: Sparse Neural Network Training, Bias and Robustness of Efficient Deep Learning methods and Domain-Agnostic Self-Supervised Learning.

We collaborate with other research groups within the university with the Artificial Intelligence Research Group, and broader, on applying machine learning and computer vision to novel problems.

news

Jul 13, 2022	Our workshop paper, (Golubeva et al., 2022), was accepted at the 2nd Sparsity in Neural Networks workshop.
Jun 13, 2022	Our workshop paper, (Adnan et al., 2022), was accepted at the ICML 2022 workshop on spurious correlations, invariance and stability.
Jan 12, 2022	Our paper, (Evci et al., 2022), has been accepted to be presented as an Oral at the 2022 AAAI Conference! The conference had a 15% acceptance rate for posters alone.
Sep 1, 2021	Yani Ioannou started as an Assistant Professor at the University of Calgary.

selected publications

AAAI

Gradient Flow in Sparse Neural Networks and How Lottery Tickets Win

Evci, Utku, Ioannou, Yani A., Keskin, Cem, and Dauphin, Yann

In Proceedings of the 36th AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada Feb 2022

arXiv Bib Poster

@inproceedings{evci2022gradientflowsparse,
  author = {{Evci}, Utku and {Ioannou}, Yani A. and {Keskin}, Cem and {Dauphin}, Yann},
  title = {{Gradient Flow in Sparse Neural Networks and How Lottery Tickets Win}},
  year = {2022},
  booktitle = {Proceedings of the 36th AAAI Conference on Artificial Intelligence},
  abbr = {AAAI},
  venue = {Vancouver, BC, Canada},
  eventdate = {2022-02-22/2022-03-1},
  month = feb,
  arxivid = {2010.03533},
  eprint = {2010.03533},
  eprinttype = {arXiv},
  poster = {https://doi.org/10.5281/zenodo.6047581},
  bibtex_show = {true},
  selected = {true}
}

NeurIPS

Domain-Agnostic Clustering with Self-Distillation

Adnan, Mohammed, Ioannou, Yani, Tsai, Chuan-Yung, and Taylor, Graham

In 2nd NeurIPS Workshop on Self-Supervised Learning: Theory and Practice, Virtual Conference Nov 2021

arXiv Bib

@inproceedings{mohammed2021clusteringselfdistillation,
  author = {Adnan, Mohammed and Ioannou, Yani and Tsai, Chuan-Yung and Taylor, Graham},
  title = {Domain-Agnostic Clustering with Self-Distillation},
  year = {2021},
  booktitle = {2nd NeurIPS Workshop on Self-Supervised Learning: Theory and Practice},
  abbr = {NeurIPS},
  month = nov,
  day = {23},
  eventdate = {2021-11-23},
  venue = {Virtual Conference},
  arxivid = {2111.12170},
  eprint = {2111.12170},
  eprinttype = {arXiv},
  bibtex_show = {true},
  selected = {true}
}

Condensing Sparse Layers

Golubeva, Anna, Lasby, Mike, Ioannou, Yani, and Nica, Mihai

In 2nd Workshop on Sparsity in Neural Networks, Virtual Jul 2022

Bib Poster

@inproceedings{golubeva2022condensed,
  author = {Golubeva, Anna and Lasby, Mike and Ioannou, Yani and Nica, Mihai},
  title = {Condensing Sparse Layers},
  year = {2022},
  booktitle = {2nd Workshop on Sparsity in Neural Networks},
  month = jul,
  day = {13},
  eventdate = {2022-07-13},
  venue = {Virtual},
  bibtex_show = {true},
  poster = {https://drive.google.com/open?id=1QQRPaFDhyEZEVKEZ73AJdP2ISDgYdu5F},
  selected = {true}
}

ICML

Monitoring Shortcut Learning using Mutual Information

Adnan, Mohammed, Ioannou, Yani, Tsai, Chuan-Yung, Galloway, Angus, Tizhoosh, H. R., and Taylor, Graham W.

In ICML 2022 Workshop on Spurious Correlations, Invariance, and Stability, Baltimore, MD, USA Jul 2022

arXiv Bib

@inproceedings{mohammed2022monitoringshortcuts,
  author = {Adnan, Mohammed and Ioannou, Yani and Tsai, Chuan-Yung and Galloway, Angus and Tizhoosh, H. R. and Taylor, Graham W.},
  title = {Monitoring Shortcut Learning using Mutual Information},
  year = {2022},
  booktitle = {ICML 2022 Workshop on Spurious Correlations, Invariance, and Stability},
  month = jul,
  day = {22},
  abbr = {ICML},
  eventdate = {2022-07-22},
  venue = {Baltimore, MD, USA},
  bibtex_show = {true},
  arxivid = {2206.13034},
  eprint = {2206.13034},
  eprinttype = {arXiv},
  selected = {true}
}