8 Key Differences Between Ineffective and Effective Machine Learning Engineers

At Abnormal, we pride ourselves on our excellent machine learning engineering team. Here are some patterns we use to distinguish between effective and ineffective ML engineers.
May 2, 2022

At Abnormal Security we pride ourselves on our excellent machine learning (ML) engineering team. Every day, our ML engineers solve problems that make our groundbreaking technology even more effective at stopping the most advanced socially-engineered attacks.

As the company grows and our team expands, we recognize our success depends on inviting the right people to join us on our mission to build the next generation of email security. This is why we have taken the time to define what effectiveness means at Abnormal.

Here, we share some patterns that we use to distinguish between effective and ineffective ML engineers.

1. Opting for Simplicity

An ineffective ML engineer uses complex algorithms without justification. They are quick to throw away existing solutions they don’t fully understand, dismissing heuristics or manual transformations in favor of fancy models.

An effective ML engineer starts by thoroughly studying the problem and the data first. They like to use the simplest approach that can completely solve the problem. They fully understand the current stack before proposing new solutions and don’t increase complexity without a sound justification.

2. Focusing on Impact

An ineffective ML engineer spends weeks on projects that have no clear path to production. They don’t think about the environments in which their models will run online, or how their work will impact the product.

An effective ML engineer thinks about the online launch from the beginning of each project. They chart the path from offline experimentation to product impact and design their offline test plan to derisk the biggest uncertainties.

3. Embracing Versatility

An ineffective ML engineer does not understand the software systems they rely upon. They become blocked easily when the exact datasets or tools they need are not available and rely heavily on software teams to support them.

An effective ML engineer is a strong programmer. They are comfortable outside of notebooks and write well-tested and readable data pipelines. They can read and write serving code as well as deploy their own models and feature serving systems when necessary.

4. Avoiding Assumptions

An ineffective ML engineer makes blind assumptions. They might assume that a feature is always accurate, that the labels they use for training represent ground truth, or that a mean is a good default for all of their continuous features. An ineffective ML engineer doesn’t question where their dataset came from, or how their model will interact with the other parts of the system.

An effective ML engineer always questions their assumptions. They have good instincts, but they aren’t afraid to challenge them. They ask questions about anything they are unsure about and write down the answers so they can reference them later. An effective ML engineer loves data wrangling—starting with the client-side signals that feed the model features and ending with the product metrics that respond to model performance.

5. Prioritizing Reproducibility

An ineffective ML engineer views the trained model as the output of their work. They don’t prioritize cleaning, testing, or refactoring their data processing or model training code.

An effective ML engineer understands the importance of reproducibility and views reproducible training pipelines as the output of their work. They refactor and clean their training code as part of the modeling process, and they write runbooks that are detailed enough for a new hire to understand.

6. Managing Uncertainty

An ineffective ML engineer is unwilling to make commitments for how long something will take, or how much of an improvement they will be able to make.

An effective ML engineer knows that ML projects have high uncertainty but also understands that a software organization cannot function without reliable estimates. They can decompose a problem and propose a path that accounts for multiple possible directions. An effective ML engineer is detail-oriented and mitigates risks early with sanity checks and simple tests.

7. Overcoming Roadblocks

An ineffective ML engineer accepts constraints at face value. They struggle to understand why certain things are hard or to communicate the problems they face to their team and leadership.

An effective ML engineer questions every constraint until they fully understand it. They propose new solutions based on first principles, external resources, or experience.

8. Designing for Resilience

An ineffective ML engineer doesn’t prioritize change resilience. Their models and features adapt poorly to infrastructure changes or data distribution shifts. They optimize for today’s performance at the expense of tomorrow’s generalizability.

An effective ML engineer produces generalizable systems. Their models and features don’t fall over in the face of distribution shifts like new customers, products, or platforms. They prefer simpler and more adaptable solutions.

Embodying Effectiveness as an ML Engineer

Effectiveness means different things in different organizations. An ML engineer in a small startup needs to prioritize versatility and velocity, whereas the most effective engineers at large companies need to build on the work of others to drive impact. Growing as an ML engineer requires understanding what effectiveness means in your organization.

For us, keeping our customers safe from the most dangerous cyber threats requires a flexible team that knows what to prioritize and how to adapt their approach based on new data. An effective ML engineer at Abnormal enjoys solving complex problems and identifying new ways to stay ahead of ever-changing threats. If this sounds like you, we’d love to hear from you! Check out our open roles to learn more.

8 Key Differences Between Ineffective and Effective Machine Learning Engineers

See Abnormal in Action

Get a Demo

Get the Latest Email Security Insights

Subscribe to our newsletter to receive updates on the latest attacks and new trends in the email threat landscape.


See the Abnormal Solution to the Email Security Problem

Protect your organization from the full spectrum of email attacks with Abnormal.

Integrates Insights Reporting 09 08 22

Related Posts

B Complex Case of Account Compromise Blog
Discover how Abnormal helped one organization detect the sophisticated tactics an attacker used to compromise an employee's email account.
Read More
B Cross Platform Account Takeover
Discover the dangers of cross-platform account takeover, the challenges of detecting this attack, and how to implement proactive protection against ATO.
Read More
B 5 17 24 Legal
Learn how cybercriminals use superficial disclaimers to deceive others while facilitating illegal activity on cybercrime forums.
Read More
B Cybersecurity Influencers Blog 2024
Stay up to date on the latest cybersecurity trends, industry news, and best practices by following these 15 innovative and influential thought leaders on social media.
Read More
B 5 13 24 Docusign
Cybercriminals are abusing Docusign by selling customizable phishing templates on cybercrime forums, allowing attackers to steal credentials for phishing and business email compromise (BEC) scams.
Read More
Abnormal employees honored as CRN 2024 Women of the Channel for their influential leadership in the tech industry.
Read More