budownictwo: Bloom filter

For example, a hash area only 18% of the size needed by an ideal error-free hash still eliminates 87% of the disk accesses..

For example, a hash area only 18% of the size needed by an ideal error-free hash still eliminates 87% of the disk accesses.

In computing, a Bloom filter is a space-efficient probabilistic data structure, conceived by Burton Howard Bloom in 1970, that is used to test whether an element is a member of a set. False positive matches are possible, but false negatives are not – in other words, a query returns either "possibly in set" or "definitely not in set". Elements can be added to the set, but not removed (though this can be addressed with the counting Bloom filter variant); the more items added, the larger the probability of false positives. Bloom proposed the technique for applications where the amount of source data would require an impractically large amount of memory if "conventional" error-free hashing techniques were applied. He gave the example of a hyphenation algorithm for a dictionary of 500,000 words, out of which 90% follow simple hyphenation rules, but the remaining 10% require expensive disk accesses to retrieve specific hyphenation patterns. With sufficient memory, an error-free hash could be used to eliminate all unnecessary disk accesses; on the other hand, with limited memory, Bloom's technique uses a smaller hash area but still eliminates most unnecessary accesses. For example, a hash area only 18% of the size needed by an ideal error-free hash still eliminates 87% of the disk accesses. More generally, fewer than 10 bits per element are required for a 1% false positive probabilit…

Kategoria: technologia

Rodzina: jezyk-i-slowa

Jakość źródła: 65/100

Próby weryfikacji: 3

Notatka fact-checku: Fact-check 3.0-content-aware: no sufficient claim-bound corroboration after 3 healthy attempts. Scope=verify the factual claim. Required independent sources=2; stored evidence groups=1. Provider/API errors did not consume attempts. | Fact-check 4.3.2: research wznowiony bez zdejmowania HOLD. Poprzednia metoda: factcheck-300-content-aware. | Fact-check 4.3.2: research wznowiony bez zdejmowania HOLD. Poprzednia metoda: factcheck-weekly-research-432.