Software security · Machine learning

MohammadhosseinAmouei

PhD Candidate / McGill University

I study how machine learning can help us understand and secure software when source code is unavailable.

I am a PhD candidate at McGill University, supervised by Prof. Benjamin C. M. Fung. My research brings together software reverse engineering, natural language processing, and representation learning.

I focus on binary code similarity: identifying related functions across compilers, optimization settings, and architectures. My broader interests include language models for code and learning-guided vulnerability discovery.

Research directions

01

AI for Cybersecurity

Developing machine learning and language-model-based methods to understand software behavior and support security analysis.

Machine learning · Language models · Software security

02

Program Analysis and Reverse Engineering

Analyzing source code and binaries to recover program semantics and identify related code across compilers, optimization settings, and architectures.

Binary analysis · Program understanding · Code similarity

03

Automated Vulnerability Detection

Detecting vulnerabilities in source code and binaries through program analysis, learned representations, and code similarity.

Vulnerability discovery · Vulnerability matching

04

Software Supply Chain Security

Investigating code provenance, third-party dependencies, and the propagation of known vulnerabilities across reused software components.

Code provenance · Dependency analysis · Software reuse

Selected publications

All publications
2026

FIN: Boosting Binary Code Embedding by Normalizing Function Inlinings

Mohammadhossein Amouei, Benjamin C. M. Fung, Philippe Charland

JSSJournal of Systems and Software

Improving binary code embeddings by addressing the structural effects of function inlining.

BibTeX
@article{fin2026,
  title = {{FIN: Boosting Binary Code Embedding by Normalizing Function Inlinings}},
  author = {Mohammadhossein Amouei and Benjamin C. M. Fung and Philippe Charland},
  year = {2026},
  journal = {Journal of Systems and Software},
  volume = {231},
  pages = {112603},
  doi = {10.1016/j.jss.2025.112603}
}
Download .bib
2026

LENA: Llama-based Embeddings of Neutralized Assembly for Cross-compiler/optimization Binary Code Similarity Detection

Mohammadhossein Amouei, Benjamin C. M. Fung, Philippe Charland, Jun Meng

IEEE TSEIEEE Transactions on Software Engineering

Llama-based representations for matching binary functions across compilers and optimization levels.

BibTeX
@article{lena2026,
  title = {{LENA: Llama-based Embeddings of Neutralized Assembly for Cross-compiler/optimization Binary Code Similarity Detection}},
  author = {Mohammadhossein Amouei and Benjamin C. M. Fung and Philippe Charland and Jun Meng},
  year = {2026},
  journal = {IEEE Transactions on Software Engineering},
  pages = {1--24},
  doi = {10.1109/TSE.2026.3705321}
}
Download .bib
2024

AsmDocGen: Generating Functional Natural Language Descriptions for Assembly Code

Jesia Yuki, Mohammadhossein Amouei, Benjamin C. M. Fung, Philippe Charland, Andrew Walenstein

ICSOFTInternational Conference on Software Technologies (ICSOFT)

Generating natural-language descriptions of assembly functions with pretrained language models.

BibTeX
@inproceedings{asmdocgen2024,
  title = {{AsmDocGen: Generating Functional Natural Language Descriptions for Assembly Code}},
  author = {Jesia Yuki and Mohammadhossein Amouei and Benjamin C. M. Fung and Philippe Charland and Andrew Walenstein},
  year = {2024},
  booktitle = {International Conference on Software Technologies (ICSOFT)},
  pages = {35--45},
  doi = {10.5220/0012761400003753}
}
Download .bib
2022

RAT: Reinforcement-Learning-Driven and Adaptive Testing for Vulnerability Discovery in Web Application Firewalls

Mohammadhossein Amouei, Mohsen Rezvani, Mansoor Fateh

IEEE TDSCIEEE Transactions on Dependable and Secure Computing

Reinforcement learning and adaptive search for testing web application firewalls.

BibTeX
@article{rat2022,
  title = {{RAT: Reinforcement-Learning-Driven and Adaptive Testing for Vulnerability Discovery in Web Application Firewalls}},
  author = {Mohammadhossein Amouei and Mohsen Rezvani and Mansoor Fateh},
  year = {2022},
  journal = {IEEE Transactions on Dependable and Secure Computing},
  volume = {19},
  number = {5},
  doi = {10.1109/TDSC.2021.3095417}
}
Download .bib

Teaching

Programming for Information Professionals

INFS 691 · Instructor · McGill University

Education

PhD in Information Studies

McGill University

2022–present

MSc in Computer Science

Shahrood University of Technology

2018–2021

BSc in Information Technology

Shahrood University of Technology

2014–2018

Get in touch

For research collaborations or questions about my work, please contact me by email.

Send an email