| chris928 |
| Newbie |
|
| Australia |
|
|
| None Specified |
|
| Thursday, November 19, 2009 |
| Wednesday, April 13, 2011 9:46:48 PM |
8
[0.04% of all post / 0.00 posts per day] |
|
|
It is not huge, really. I am mapping XML to Access db with over 1 million record tables. The problem is not in your RAM size but Java VM memory allocation. I tried increasing Java VM memory according to the documentation, but it didn't help, though my RAM is 8GB. The only way is to split large XML files into small ones. MapForce can handle XMLs up to 70-80MB quite well. With my experience the troubles start after 100MB.
|
Vlad,
I tried this and it works on small files, but in my case I am getting "memory full" exceptions. Is there a way of doing it the following way with MapForce automatically:
1) take 1st file, generate mapping and SQL queries and execute SQL
2) take the 2nd file etc etc
If I use myXMLs-*.xml, it tries loading all the XML files one-by-one and I am getting into the memory troubles because all XMLs are over 300-400MB together.
I can do it manually, but am still trying to automate it somehow.
Thanks
Chris
|
Hi All,
I have several XML files (the identical structure) that need to be mapped into a single database. What is a right way of doing this?
Let's say i have myXML-1.xml, myXML-2.xml etc.
I guess I can define input XMLs like myXMLs-*.xml. Correct? What happens with the output query? Will it be generated and executed at once for all files or one-by-one? Every single XML file creates about 500,000 queries, therefore I cannot do it at once because of memory problems.
Please, advise.
Thanks,
Chris
|
|
Finally, I have resolved it by splitting into several XML files. I have been using firstobject editor with a custom foal code. I tried splitting files up to 500MB; works great
|
|
Can I split large XML files with some Altova applications?
|
Thank you for replying. it looks as the problem is because of the XML size.
Every time when I try large XML files with mapForce, it shoes the same error "character #xDBC0..."
Are there any tricks how to work with large files 200MB and more?
Thanks
|
Hi All,
A dumb question - how can I delete the content from a table before executing Insert action? I need to generate new content all the time and cannot figure out the settings for this.
Please, advise.
Thanks
|
Hi All,
when I click the "Output" tab after mapping XML to Access mdb, I am getting an error:
Failed to load XML file..... (Message "character #xDBC0 is grammatically unexpected")
How can I fix this? What is the "wrong" symbol in the XML I should be looking for?
Thanks!
Chris
|
|
