Login  Register

Re: Trouble opening large files

Posted by Nicolai Hess on Oct 14, 2014; 7:01pm
URL: https://forum.world.st/Trouble-opening-large-files-tp4784403p4784569.html

Rebuild pharo vm with D_FILE_OFFSET_BITS=64 option:
Reading list directories with (very) large files working now.



2014-10-14 20:26 GMT+02:00 Nicolai Hess <[hidden email]>:
There is a bug report on mantis for squeaks unix vm.
I think this applies to pharo too, although I don't know if this
bug is still valid on recent squeak vm.

2014-10-14 17:43 GMT+02:00 Evan Donahue <[hidden email]>:
The OS is Arch Linux.

I can read the file with less.

The problem, insofar as I can trace it, seems to stem from this line in UnixStore:

Primitives lookupDirectory: encodedPath filename: encodedBasename

When I have my 57G file there this line returns nil. If I move the 57G file and create a small file with the same name, the same command successfully finds the file. I am not sure how large a file must be to cause this issue, but A 1.5G file works fine.

On Tue, Oct 14, 2014 at 8:17 AM, Nicolai Hess <[hidden email]> wrote:
2014-10-14 6:38 GMT+02:00 Evan Donahue <[hidden email]>:
Hi, thanks for the reply.

The response is the same: "MessageNotUnderstood: False>>humanReadableSIByteSize."

This happens both to print-it as well as to do-it-and-go. Running the command on the neighboring "wiki.torrent" torrent file yields the correct 54kb.

Thanks,
Evan

On Tue, Oct 14, 2014 at 12:24 AM, Tudor Girba <[hidden email]> wrote:
Hi,

If I understand correctly, the failure occurs while navigating in the "Items" presentation.

I cannot reproduce this problem because I do not have enough disk space for such a large file :). But, could you do the following and let me know what the outcome is:

'path/to/your/large/file.xml' asFileReference humanReadableSize

?

Cheers,
Doru



On Tue, Oct 14, 2014 at 2:27 AM, Evan Donahue <[hidden email]> wrote:
Hello, I've run into some odd behavior and wanted to check whether I might be missing something:

I have downloaded a copy of the english wikipedia as an xml file and am hoping to (sax) parse it. However, I can't even seem to get pharo to recognize that the file exists.

If I open FileSystem disk root in the playground and naigate, attempting to enter the folder containing the (57G) xml file fails with "MessageNotUnderstood: False>>humanReadableSIByteSize." Likewise if I get a FileReference with FileSystem disk root / 'path' / 'to' / 'file' then self exists returns false and the parser fails.

Am I doing something wrong? Should I be able to do this?

The version number is #40283

Thanks,
Evan



--

"Every thing has its own flow"



Which OS ?
Can you check with other programs if this file is readable at all?




Nicolai