Concurrent Loader
Works just like the GenericLoader but concurrently for those who choose to optimize their workflow.
from langchain_community.document_loaders import ConcurrentLoader
API Reference:ConcurrentLoader
loader = ConcurrentLoader.from_filesystem("example_data/", glob="**/*.txt")
files = loader.load()
len(files)
2
Related
- Document loader conceptual guide
- Document loader how-to guides