C. M. Sperberg-McQueen
2017-07-12 04:14:46 UTC
I’m working on some XQuery code for language corpora and testing
a function that reads a corpus and gathers information about its
contents. The function works fine on the one-million word Brown Corpus,
but it’s failing with an out-of-memory error on the five-million-word
Hamburg Dependency Treebank (the XML for which is somewhat
more verbose than Brown’s).
Before I spend a lot of time trying to rewrite the code to reduce
memory usage: Is there a quick way to give the BaseX GUI
interface more memory?
Once the code is more complete, it will make sense to try to improve
its speed and lower its resource consumption (and at that point I’ll
surely have lots of questions for the list), but for the moment I would
prefer to postpone such considerations, and focus on writing code I
understand.
Thanks!
********************************************
C. M. Sperberg-McQueen
Black Mesa Technologies LLC
***@blackmesatech.com
http://www.blackmesatech.com
********************************************
a function that reads a corpus and gathers information about its
contents. The function works fine on the one-million word Brown Corpus,
but it’s failing with an out-of-memory error on the five-million-word
Hamburg Dependency Treebank (the XML for which is somewhat
more verbose than Brown’s).
Before I spend a lot of time trying to rewrite the code to reduce
memory usage: Is there a quick way to give the BaseX GUI
interface more memory?
Once the code is more complete, it will make sense to try to improve
its speed and lower its resource consumption (and at that point I’ll
surely have lots of questions for the list), but for the moment I would
prefer to postpone such considerations, and focus on writing code I
understand.
Thanks!
********************************************
C. M. Sperberg-McQueen
Black Mesa Technologies LLC
***@blackmesatech.com
http://www.blackmesatech.com
********************************************