awkreader: File Reading with Pre-Filtering, Pattern Searching, and
Distributed Files
Provides high-performance tools for out-of-core text processing and data ingestion by leveraging system 'AWK' utilities. Allows users to count records, filter rows, and compute streaming aggregations—such as group-by means, streaming medians, standard deviations, and correlations—directly on disk prior to reading data into R. By delegating line-by-line filtering and summarization to system-level 'AWK' commands and streaming results back through data.table::fread(), the package significantly reduces memory footprint and execution times when working with large individual files or multi-file directory structures.
| Version: |
0.1.0 |
| Imports: |
data.table |
| Suggests: |
knitr, rmarkdown, testthat (≥ 3.0.0) |
| Published: |
2026-09-03 |
| DOI: |
10.32614/CRAN.package.awkreader (may not be active yet) |
| Author: |
David Shilane [aut],
Akshat Maurya [aut, cre],
Jason Livingston [aut],
Chung-Woo (Caffrey) Lee [aut],
Mayur Bansal [aut],
Srivastav Budugutta [aut] |
| Maintainer: |
Akshat Maurya <codingmaster902 at gmail.com> |
| License: |
MIT + file LICENSE |
| NeedsCompilation: |
no |
| CRAN checks: |
awkreader results |
Documentation:
Downloads:
Linking:
Please use the canonical form
https://CRAN.R-project.org/package=awkreader
to link to this page.