Benchmark
Collection preparation and complete filesystem import over increasing synthetic corpora. Setup and publication are outside timed work. Import includes bounded reads, JSON decoding, canonical hashes, shape validation and indexed provenance reconstruction. Memory is BEAM allocation measured by Benchee, not peak RSS. These are local measurements, not performance thresholds.
System
Benchmark suite executing on the following system:
| Operating System | macOS |
|---|---|
| CPU Information | Apple M4 Max |
| Number of Available Cores | 16 |
| Available Memory | 128 GB |
| Elixir Version | 1.20.4 |
| Erlang Version | 29.0.4 |
Configuration
Benchmark suite executing with the following configuration:
| :time | 3 s |
|---|---|
| :parallel | 1 |
| :warmup | 1 s |
Statistics
Input: 1000 documents
Run Time
| Name | IPS | Average | Deviation | Median | 99th % |
|---|---|---|---|---|---|
| Collection.prepare/2 | 357.14 | 2.80 ms | ±10.65% | 2.71 ms | 3.57 ms |
| Collection.load/1 | 35.70 | 28.01 ms | ±24.49% | 29.70 ms | 40.48 ms |
Run Time Comparison
| Name | IPS | Slower |
|---|---|---|
| Collection.prepare/2 | 357.14 | |
| Collection.load/1 | 35.70 | 10.0x |
Memory Usage
| Name | Average | Factor |
|---|---|---|
| Collection.prepare/2 | 4.98 MB | |
| Collection.load/1 | 32.70 MB | 6.57x |
Input: 16000 documents
Run Time
| Name | IPS | Average | Deviation | Median | 99th % |
|---|---|---|---|---|---|
| Collection.prepare/2 | 15.38 | 65.03 ms | ±1.49% | 64.91 ms | 67.29 ms |
| Collection.load/1 | 1.82 | 549.02 ms | ±1.90% | 548.82 ms | 562.43 ms |
Run Time Comparison
| Name | IPS | Slower |
|---|---|---|
| Collection.prepare/2 | 15.38 | |
| Collection.load/1 | 1.82 | 8.44x |
Memory Usage
| Name | Average | Factor |
|---|---|---|
| Collection.prepare/2 | 81.57 MB | |
| Collection.load/1 | 530.61 MB | 6.51x |
Input: 4000 documents
Run Time
| Name | IPS | Average | Deviation | Median | 99th % |
|---|---|---|---|---|---|
| Collection.prepare/2 | 85.99 | 11.63 ms | ±1.74% | 11.64 ms | 12.21 ms |
| Collection.load/1 | 8.77 | 114.07 ms | ±3.61% | 115.33 ms | 120.74 ms |
Run Time Comparison
| Name | IPS | Slower |
|---|---|---|
| Collection.prepare/2 | 85.99 | |
| Collection.load/1 | 8.77 | 9.81x |
Memory Usage
| Name | Average | Factor |
|---|---|---|
| Collection.prepare/2 | 20.14 MB | |
| Collection.load/1 | 131.68 MB | 6.54x |
Input: 8000 documents
Run Time
| Name | IPS | Average | Deviation | Median | 99th % |
|---|---|---|---|---|---|
| Collection.prepare/2 | 40.41 | 24.74 ms | ±1.86% | 24.72 ms | 25.69 ms |
| Collection.load/1 | 2.29 | 436.99 ms | ±28.05% | 494.97 ms | 575.07 ms |
Run Time Comparison
| Name | IPS | Slower |
|---|---|---|
| Collection.prepare/2 | 40.41 | |
| Collection.load/1 | 2.29 | 17.66x |
Memory Usage
| Name | Average | Factor |
|---|---|---|
| Collection.prepare/2 | 40.54 MB | |
| Collection.load/1 | 264.25 MB | 6.52x |