Step-by-step guide
We recommend adding the tag
#tuned to emails that you performed some tuning actions on. This will help you avoid looking at the same issue twice. You can also supplement every search query with not #tuned to exclude these cases from the results.1️⃣ Authentication
2️⃣ False positive tuning
3️⃣ False negative tuning
Use#inc #untrusted not verdict:reputable not verdict:popular #domainonlyinbound not #quarantine not #dmarcreport or parts of it to find suspicious emails.
- Report false negative to xorlab.
- Add sender or link to blacklists.
- Create a campaign.
- Follow Advanced Tuning to evaluate if you want to enable or disable specific rules.
4️⃣ Advanced tuning
This section explains how to tune individual detection rules for false positives and false negatives by checking impact and changing rule states when needed.False positive tuning
- Read Understanding Verdicts to learn what verdict rules are and how you can use the Classifiers & Rules tab to identify them.
- Check if multiple false positives in your quarantine are caused by the same verdict rule.
- To check the impact of this rule, search for
rule:rule-name #quarantine(see Search). - Go through the results to assess the legitimacy of every email. For every true positive that you find, check if any other verdict rules (e.g.,
PHISHING_...) triggered on this email. If so, this email would still be blocked by the other rules. To only see emails that would be delivered after disabling the rule in question, exclude all other occurring verdict rules from the query like this:rule:verdict_rule-name not rule:verdict_other-rule-name #quarantine. - If you do this and only end up with false positives, you can disable this rule by adding its name appended with
_state=PASSIVEtolocal.properties, for examplePHISHING_risk_based_one_suspicious_state=PASSIVE
- To check the impact of this rule, search for
- Check if a passive ADAPT_ rule would match the false positives in your quarantine.
- To check the impact of this rule, search for
passiverule:ADAPT_rule-name #quarantine(see Search). - Examine the search results to see if the other emails that matched this ADAPT_ rule are also false positives that should have been delivered.
- If the passive rule mostly matched false positives, you can activate the rule by adding its name appended with
_state=ACTIVEtolocal.properties, for exampleADAPT_phishing_confidence_low_based_on_link_with_from_domain_state=ACTIVE
- To check the impact of this rule, search for
False negative tuning
- Check if your false negatives are caused by a specific ADAPT_ rule.
- To check the impact of this rule, search for
rule:rule-name #deliver(see Search). - Go through the results to assess the legitimacy of every email. For every true negative that you find, exclude any other active ADAPT_ rules that also trigger on the same email from the query like this:
rule:ADAPT_rule-name not rule:ADAPT_other-rule-name #deliver. - If you do this and only end up with false negatives, you can disable this rule by adding its name appended with
_state=PASSIVEtolocal.properties, for example:ADAPT_phishing_confidence_high_state=PASSIVE
- To check the impact of this rule, search for
- Check if a passive verdict- or FILTER_ rule would match your false negatives.
- To check the impact of this rule, search for
passiverule:VERDICT_rule-name #deliver(see Search). - Examine the search results to see if the other emails that matched this passive rule are also false negatives that should have been quarantined.
- If the passive rule mostly matched false negatives, you can activate the rule by adding its name appended with
_state=ACTIVEto/activeguard/core/rule_sets/90_local/params/local.properties, for examplePHISHING_risk_based_one_suspicious_state=ACTIVE
- To check the impact of this rule, search for