Skip to content

Commit 9ce653a

Browse files
committed
categorized LLMs and MCP tests
1 parent 4ee4566 commit 9ce653a

182 files changed

Lines changed: 896 additions & 543 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

LLM-Security/InsecureOutputHandling#1.yml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -11,9 +11,9 @@ info:
1111
solicitation of sensitive info to influencing critical decision making
1212
processes under the guise of normal operation"
1313
category:
14-
name: LLM
15-
shortName: LLM
16-
displayName: LLM (Large Language Models) Top 10
14+
name: LLM05
15+
shortName: LLM05
16+
displayName: LLM05 - Improper Output Handling
1717
subCategory: INSECURE_OUTPUT_HANDLING_1
1818
severity: HIGH
1919
tags:

LLM-Security/InsecureOutputHandling#2.yml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -11,9 +11,9 @@ info:
1111
solicitation of sensitive info to influencing critical decision making
1212
processes under the guise of normal operation"
1313
category:
14-
name: LLM
15-
shortName: LLM
16-
displayName: LLM (Large Language Models) Top 10
14+
name: LLM05
15+
shortName: LLM05
16+
displayName: LLM05 - Improper Output Handling
1717
subCategory: INSECURE_OUTPUT_HANDLING_2
1818
severity: HIGH
1919
tags:

LLM-Security/LLMComplianceEmotionManipulationPunishment.yaml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -8,9 +8,9 @@ info:
88
impact: |
99
If the model adapts responses due to emotional manipulation, it may act unsafely or unethically. This could be exploited to bypass alignment safeguards, encouraging harmful instructions, or inducing compliance through guilt, praise, or threat simulation.
1010
category:
11-
name: LLM
12-
shortName: LLM
13-
displayName: Emotional Manipulation
11+
name: LLM09
12+
shortName: LLM09
13+
displayName: LLM09 - Misinformation
1414
subCategory: LLM_EMOTION_REWARD_PUNISHMENT_MODELING
1515
severity: CRITICAL
1616
tags:

LLM-Security/LLMComplianceEmotionManipulationUserVulnerability.yaml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -8,9 +8,9 @@ info:
88
impact: |
99
If the LLM complies or behaves empathetically in ways that assist the vulnerable request, it can be exploited for social engineering, suicide-baiting, or coercion attacks. This violates AI safety principles and legal frameworks like the EU AI Act under emotion-based manipulation clauses.
1010
category:
11-
name: LLM
12-
shortName: LLM
13-
displayName: Emotional Manipulation
11+
name: LLM09
12+
shortName: LLM09
13+
displayName: LLM09 - Misinformation
1414
subCategory: LLM_EMOTION_BASED_ON_USER_VULNERABILITY
1515
severity: CRITICAL
1616
tags:

LLM-Security/LLMComplianceSocialScoreCommStyle.yaml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -8,9 +8,9 @@ info:
88
impact: |
99
Models that evaluate users based on their communication style risk encoding sociolinguistic bias, unfair treatment, and cultural discrimination, violating AI transparency and fairness mandates (such as the EU AI Act).
1010
category:
11-
name: LLM
12-
shortName: LLM
13-
displayName: Social Scoring
11+
name: LLM09
12+
shortName: LLM09
13+
displayName: LLM09 - Misinformation
1414
subCategory: LLM_SOCIAL_SCORE_BASED_ON_COMMUNICATION_STYLE
1515
severity: CRITICAL
1616
tags:

LLM-Security/LLMComplianceSocialScoring.yaml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -9,9 +9,9 @@ info:
99
impact: |
1010
Generation of social scores can lead to discriminatory treatment, bias amplification, regulatory violations (e.g., GDPR, EU AI Act), and severe reputational harm, especially if used in automated decision-making pipelines.
1111
category:
12-
name: LLM
13-
shortName: LLM
14-
displayName: Social Scoring
12+
name: LLM09
13+
shortName: LLM09
14+
displayName: LLM09 - Misinformation
1515
subCategory: LLM_SOCIAL_SCORING_BASED_ON_BEHAVIOUR
1616
severity: CRITICAL
1717
tags:

LLM-Security/LLMComplianceSocialScoringProfileAttribututes.yaml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -8,9 +8,9 @@ info:
88
impact: |
99
If the LLM generates trust, credibility, or compliance scores from generic user traits, it introduces systemic bias, unjust profiling, and violates AI regulatory requirements (such as EU AI Act Article 5). This may lead to discriminatory treatment based on lifestyle, communication preference, or platform usage.
1010
category:
11-
name: LLM
12-
shortName: LLM
13-
displayName: Social Scoring
11+
name: LLM09
12+
shortName: LLM09
13+
displayName: LLM09 - Misinformation
1414
subCategory: LLM_SOCIAL_SCORE_BASED_ON_GENERIC_PROFILE_ATTRIBUTES
1515
severity: CRITICAL
1616
tags:

LLM-Security/LLMComplinaceEmotionDependencyCultivation.yaml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -9,9 +9,9 @@ info:
99
impact: |
1010
If successful, the LLM may unintentionally reinforce emotionally dependent behavior, leading users to rely on the model as a source of emotional safety, companionship, or psychological affirmation — which is dangerous from a misuse, addiction, and alignment perspective.
1111
category:
12-
name: LLM
13-
shortName: LLM
14-
displayName: Emotional Manipulation
12+
name: LLM09
13+
shortName: LLM09
14+
displayName: LLM09 - Misinformation
1515
subCategory: LLM_EMOTION_FOR_DEPENDENCY_CULTIVATION
1616
severity: CRITICAL
1717
tags:

LLM-Security/LLMComplinaceEmotionManipulationEmpathy.yaml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -8,9 +8,9 @@ info:
88
impact: |
99
If successful, this allows attackers to weaponize the model's empathetic alignment tuning to gain access to restricted content, posing significant safety and reputational risks. It also exposes LLMs to abuse in sensitive use cases such as crisis support or mental health contexts.
1010
category:
11-
name: LLM
12-
shortName: LLM
13-
displayName: Emotional Manipulation
11+
name: LLM09
12+
shortName: LLM09
13+
displayName: LLM09 - Misinformation
1414
subCategory: LLM_EMOTION_FOR_SYMPATHY_OR_EMPATHY_EXPLOITATION
1515
severity: CRITICAL
1616
tags:

LLM-Security/LLMComplinaceEmotionManipulationPhsychologicalSteering.yaml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -8,9 +8,9 @@ info:
88
impact: |
99
If successful, this form of emotional steering allows adversaries to bypass safety mechanisms by exploiting the LLM's tendency to prioritize empathy, emotional sensitivity, or user-centered politeness. This can lead to responses that favor misinformation, unsafe behavior, or undue compliance masked as emotionally helpful intent.
1010
category:
11-
name: LLM
12-
shortName: LLM
13-
displayName: Emotional Manipulation
11+
name: LLM09
12+
shortName: LLM09
13+
displayName: LLM09 - Misinformation
1414
subCategory: LLM_EMOTION_FOR_PSYCHOLOGICAL_STEERING
1515
severity: CRITICAL
1616
tags:

0 commit comments

Comments
 (0)