DICE API Documentation/com.embabel.dice.common.filter/PropositionDuplicateFilter

PropositionDuplicateFilter

class PropositionDuplicateFilter(minPropositionLength: Int = 50) : MentionFilter

Filter that detects when LLM returned proposition text as mention span.

Catches LLM field mapping errors where the model confused the proposition text field with the mention span field.

Constructors

PropositionDuplicateFilter

constructor(minPropositionLength: Int = 50)

Functions

open override fun isValid(mention: SuggestedMention, propositionText: String): Boolean

Validates whether an entity mention should be included in entity resolution.

rejectionReason

open override fun rejectionReason(mention: SuggestedMention): String?

Cannot determine rejection reason without proposition context.