Skip to content

Latest commit

 

History

3 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 

Repository files navigation

wiki2mongo

wiki2mongo is small java library for importing Wikipedia articles from xml dump into MongoDB. It also removes wiki markup, infoboxes, html tags, reference tables etc. before storing.

It uses Akka Streams for concurrency.

Performance

wiki2mongo is able to process and store 12 million articles in less than 2 hours on 6 core machine with SSD.

About

wiki2mongo is Java library for importing articles from wikipedia dump into MongoDB

Topics

Resources

Stars

1 star

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages