Comments on: Bulk Import from a Filesystem

By: Peter Monks

Peter Monks — Fri, 13 Jan 2012 03:32:18 +0000

Pallavi, can I suggest you raise this on the project's mailing list? That's a much better forum for discussing topics like this one.

By: Pallavi

Pallavi — Thu, 12 Jan 2012 13:30:12 +0000

Hi,
I was using your bulk import tool.It works great. I would like to know how can we declare the imported files as records. In one of the books i read we can give the cm:declareRecords in aspects tag and then give all the mandatory properties. The file will be declared as record. But it doesnt seem to work for me. Can someone help please

Pallavi

By: Peter Monks

Peter Monks — Mon, 10 Oct 2011 21:08:56 +0000

Luiz, would you mind raising this in the mailing list? That's a much better forum for discussing topics like this one.

By: Luiz Candido Borges

Luiz Candido Borges — Mon, 10 Oct 2011 18:54:27 +0000

Peter, I’m sorry for the previous post: the xml sample I’ve sent didn’t work well in your blog. If you want, I can send then attachen on e-mail.

Best regards,

By: Luiz Candido Borges

Luiz Candido Borges — Mon, 10 Oct 2011 18:48:24 +0000

I'm trying to use the Alfesco Bulk Filesystem Import on Community Edition 3.4.d (RHEL platform). After some troubles to import content - the Source Directory must be under /tomcat/bin (I'm sure this is not a standard way) - I didn't arrive to import metadata. I mixed the content files with respective metadata files in the same hierachical organization as in the repository. As result, the content is loaded but not the metadata. In fact, the metadata file is loaded into repository as any other file. Is this the correct way to load metadata? The documentation is very succint: it shows how configurate but not how to use. Thanks for your help, Additional information: Custom content model file (it's working well by using Alfresco Explorer) Customizacao para o Laboratorio de Conversao de Midia Candido 2011-09-29 1.0 Relacao de Lancamento por Lote cm:content Microfilmagem d:text true false true A metadata file: cm:digitalizacao01 1234/1056-1078 Lote de Lancamento Roseli

By: Peter Monks

Peter Monks — Thu, 29 Sep 2011 21:28:57 +0000

I've just created a mailing list to help facilitate assistance with and discussion of the tool. Please try to use that resource rather than commenting here, since blog comments aren't great for that kind of thing. Thanks!

By: Peter Monks

Peter Monks — Thu, 29 Sep 2011 18:52:46 +0000

Zhihai, I’ve updated issue #88 [1] with more information, and confirmed that it is indeed a duplicate of issue #57 [2]. Once you correct your metadata files, everything should work as expected.

[1] http://code.google.com/p/alfresco-bulk-filesystem-import/issues/detail?id=88
[2] http://code.google.com/p/alfresco-bulk-filesystem-import/issues/detail?id=57

By: Zhihai Liu

Zhihai Liu — Thu, 29 Sep 2011 15:19:17 +0000

Hi Peter,

I ran into an exception when trying an import with the 1.0 release. The error seemed to happen on multi-valued cm:taggable property in the metadata file. I created a new issue as http://code.google.com/p/alfresco-bulk-filesystem-import/issues/detail?id=88. Later on I found a related issue here
http://code.google.com/p/alfresco-bulk-filesystem-import/issues/detail?id=57. Do you mind taking a look?

Thanks.

By: Peter Monks

Peter Monks — Mon, 26 Sep 2011 06:56:49 +0000

Jordi, I'd be very interested in seeing an example file that causes the NPE, along with the full stack trace for the UTF-8 vs ISO-8859 issue. Would you mind raising an issue in the issue tracker?

By: Jordi Anguela

Jordi Anguela — Mon, 26 Sep 2011 01:06:02 +0000

Hi Peter,

thank you for your reply. We have tried to use VisualVM to detect a bottleneck without luck. However, apparently we solved the issue regarding the slowness with the record’s ingestion in the RM Site. You know that the File Plan in the RM site has 4 levels (Series, Categories, Record Folders & Records Files). In our first test we had created the shadow files ONLY for the Record Folders (and skipping the Series and Categories). When the shadow files for the Series & Categories were created then the tool worked much better: 5000 records in 15min (on my local deployment)

Another important information that we have discovered along the process and that you could add to the documentation is that you need to create the shadow files specifically in “UTF-8″. java.io.FileWriter class doesn’t use UTF-8 by default (it uses ISO-8859-1) and this was generating a NullPointerException during the execution.

Hope this information is useful,
Regards, Jordi