Calgary ML Lab

The Calgary Machine Learning Lab is a research group led by Yani Ioannou within the Schulich School of Engineering at the University of Calgary. The lab has a research focus on improving Deep Neural Network (DNN) training and models, in particular for computer vision applications. Topics of research include: Sparse Neural Network Training, Bias and Robustness of Efficient Deep Learning methods and Domain-Agnostic Self-Supervised Learning.

We collaborate with other research groups within the university with the Artificial Intelligence Research Group, and broader, on applying machine learning and computer vision to novel problems.

news

Sep 1, 2022	Our newest lab member, Aida Mohammadshahi, has been awarded an Alberta Graduate Excellence Scholarship (AGES) to support her MSc. studies. The AGES scholarships are awarded to students enrolled in an Alberta-based Graduate degree, and are based on outstanding academic achievement.
Aug 30, 2022	We have been awarded a 2022 National Sciences and Engineering Research Council of Canada (NSERC) and Department’s of National Defence (DND) Discovery Grant Supplement — one of only 20 awarded nationally! This supplement will help accelerate our research over the next 3 years.
Jul 13, 2022	Our workshop paper, (Golubeva et al., 2022), was accepted at the 2nd Sparsity in Neural Networks workshop.
Jun 25, 2022	We are grateful to have been awarded a 2022 National Sciences and Engineering Research Council of Canada (NSERC) Discovery Grant and Discovery Launch Supplement to support our research over the next 5 years.
Jun 13, 2022	Our workshop paper, (Adnan et al., 2022), was accepted at the ICML 2022 workshop on spurious correlations, invariance and stability.

selected publications

AAAI

Gradient Flow in Sparse Neural Networks and How Lottery Tickets Win

Evci, Utku, Ioannou, Yani A., Keskin, Cem, and Dauphin, Yann

In Proceedings of the 36th AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada Feb 2022

arXiv Bib Poster

@inproceedings{evci2022gradientflowsparse,
  author = {{Evci}, Utku and {Ioannou}, Yani A. and {Keskin}, Cem and {Dauphin}, Yann},
  title = {{Gradient Flow in Sparse Neural Networks and How Lottery Tickets Win}},
  year = {2022},
  booktitle = {Proceedings of the 36th AAAI Conference on Artificial Intelligence},
  abbr = {AAAI},
  venue = {Vancouver, BC, Canada},
  eventdate = {2022-02-22/2022-03-1},
  month = feb,
  arxivid = {2010.03533},
  eprint = {2010.03533},
  eprinttype = {arXiv},
  poster = {https://doi.org/10.5281/zenodo.6047581},
  bibtex_show = {true},
  selected = {true}
}

NeurIPS

Domain-Agnostic Clustering with Self-Distillation

Adnan, Mohammed, Ioannou, Yani, Tsai, Chuan-Yung, and Taylor, Graham

In 2nd NeurIPS Workshop on Self-Supervised Learning: Theory and Practice, Virtual Conference Nov 2021

arXiv Bib

@inproceedings{mohammed2021clusteringselfdistillation,
  author = {Adnan, Mohammed and Ioannou, Yani and Tsai, Chuan-Yung and Taylor, Graham},
  title = {Domain-Agnostic Clustering with Self-Distillation},
  year = {2021},
  booktitle = {2nd NeurIPS Workshop on Self-Supervised Learning: Theory and Practice},
  abbr = {NeurIPS},
  month = nov,
  day = {23},
  eventdate = {2021-11-23},
  venue = {Virtual Conference},
  arxivid = {2111.12170},
  eprint = {2111.12170},
  eprinttype = {arXiv},
  bibtex_show = {true},
  selected = {true}
}

Condensing Sparse Layers

Golubeva, Anna, Lasby, Mike, Ioannou, Yani, and Nica, Mihai

In 2nd Workshop on Sparsity in Neural Networks, Virtual Jul 2022

Bib Poster

@inproceedings{golubeva2022condensed,
  author = {Golubeva, Anna and Lasby, Mike and Ioannou, Yani and Nica, Mihai},
  title = {Condensing Sparse Layers},
  year = {2022},
  booktitle = {2nd Workshop on Sparsity in Neural Networks},
  month = jul,
  day = {13},
  eventdate = {2022-07-13},
  venue = {Virtual},
  bibtex_show = {true},
  poster = {https://drive.google.com/open?id=1QQRPaFDhyEZEVKEZ73AJdP2ISDgYdu5F},
  selected = {true}
}

ICML

Monitoring Shortcut Learning using Mutual Information

Adnan, Mohammed, Ioannou, Yani, Tsai, Chuan-Yung, Galloway, Angus, Tizhoosh, H. R., and Taylor, Graham W.

In ICML 2022 Workshop on Spurious Correlations, Invariance, and Stability, Baltimore, MD, USA Jul 2022

arXiv Bib

@inproceedings{mohammed2022monitoringshortcuts,
  author = {Adnan, Mohammed and Ioannou, Yani and Tsai, Chuan-Yung and Galloway, Angus and Tizhoosh, H. R. and Taylor, Graham W.},
  title = {Monitoring Shortcut Learning using Mutual Information},
  year = {2022},
  booktitle = {ICML 2022 Workshop on Spurious Correlations, Invariance, and Stability},
  month = jul,
  day = {22},
  abbr = {ICML},
  eventdate = {2022-07-22},
  venue = {Baltimore, MD, USA},
  bibtex_show = {true},
  arxivid = {2206.13034},
  eprint = {2206.13034},
  eprinttype = {arXiv},
  selected = {true}
}