Mantis issue 7522 (dealing with files > 2GB on linux)

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Mantis issue 7522 (dealing with files > 2GB on linux)

Hans-Martin Mosner
 
Hello,
quite some time ago (early 2010) I posted an issue on mantis about the linux VM's handling of files > 2GB.
I don't remember whether I sent a report on the list, too, but in any case, current VMs still have the problem.
IIRC, I had a half-working solution at that time, but I'm not sure what the right way is for getting this problem solved
now.
Could anybody please have a short look at this? It would be great if future VMs would be able to handle files of this
size (many video files are bigger than that limit.)

Cheers,
Hans-Martin
Reply | Threaded
Open this post in threaded view
|

Re: Mantis issue 7522 (dealing with files > 2GB on linux)

David T. Lewis
 
On Sun, Jul 24, 2011 at 04:41:50PM +0200, Hans-Martin Mosner wrote:
>  
> Hello,
> quite some time ago (early 2010) I posted an issue on mantis about the linux VM's handling of files > 2GB.
> I don't remember whether I sent a report on the list, too, but in any case, current VMs still have the problem.
> IIRC, I had a half-working solution at that time, but I'm not sure what the right way is for getting this problem solved
> now.
> Could anybody please have a short look at this? It would be great if future VMs would be able to handle files of this
> size (many video files are bigger than that limit.)

Hans-Martin,

The Mantis report is <http://bugs.squeak.org/view.php?id=7522>. I just
assigned it to myself (it had previously been unassigned, sorry).

You mention that you had a half-working solution last year. Can you
describe the approach or post some code if you still have it?

Thanks,
Dave

Reply | Threaded
Open this post in threaded view
|

Re: Mantis issue 7522 (dealing with files > 2GB on linux)

Hans-Martin Mosner
 
Am 24.07.2011 17:05, schrieb David T. Lewis:

>  
> On Sun, Jul 24, 2011 at 04:41:50PM +0200, Hans-Martin Mosner wrote:
>>  
>> Hello,
>> quite some time ago (early 2010) I posted an issue on mantis about the linux VM's handling of files > 2GB.
>> I don't remember whether I sent a report on the list, too, but in any case, current VMs still have the problem.
>> IIRC, I had a half-working solution at that time, but I'm not sure what the right way is for getting this problem solved
>> now.
>> Could anybody please have a short look at this? It would be great if future VMs would be able to handle files of this
>> size (many video files are bigger than that limit.)
> Hans-Martin,
>
> The Mantis report is <http://bugs.squeak.org/view.php?id=7522>. I just
> assigned it to myself (it had previously been unassigned, sorry).
>
> You mention that you had a half-working solution last year. Can you
> describe the approach or post some code if you still have it?
>
> Thanks,
> Dave
>
>
I'll look up the code - I've got several half-baked VMMaker directoriey, but I think I'll be able to find it.

Thanks for looking into this!

Cheers,
Hans-Martin
Reply | Threaded
Open this post in threaded view
|

Re: Mantis issue 7522 (dealing with files > 2GB on linux)

Hans-Martin Mosner
In reply to this post by David T. Lewis
 
Am 24.07.2011 17:05, schrieb David T. Lewis:

>  
> On Sun, Jul 24, 2011 at 04:41:50PM +0200, Hans-Martin Mosner wrote:
>>  
>> Hello,
>> quite some time ago (early 2010) I posted an issue on mantis about the linux VM's handling of files > 2GB.
>> I don't remember whether I sent a report on the list, too, but in any case, current VMs still have the problem.
>> IIRC, I had a half-working solution at that time, but I'm not sure what the right way is for getting this problem solved
>> now.
>> Could anybody please have a short look at this? It would be great if future VMs would be able to handle files of this
>> size (many video files are bigger than that limit.)
> Hans-Martin,
>
> The Mantis report is <http://bugs.squeak.org/view.php?id=7522>. I just
> assigned it to myself (it had previously been unassigned, sorry).
>
> You mention that you had a half-working solution last year. Can you
> describe the approach or post some code if you still have it?
>
> Thanks,
> Dave
>
>
I've looked at the files, and I think I was unsure at the time where to put the changes.
There is a preprocessor define __USE_FILE_OFFSET64 , which should be defined
pretty much before other linux include files will be read, so that off_t will be defined as __off64_t.
I do not remember whether I tried to define that in the makefile and got problems in the make process,
so I moved it into selected header or C files, or whether I directly started with the files - in any case, I think I did
not get a fully working VM.

I can try to set up a working build environment with VMMaker and everything, however, I don't know
whether I will have time to do that before my vacation next week.

Cheers,
Hans-Martin
Reply | Threaded
Open this post in threaded view
|

Re: Mantis issue 7522 (dealing with files > 2GB on linux)

David T. Lewis
 
On Sun, Jul 24, 2011 at 08:56:59PM +0200, Hans-Martin Mosner wrote:

>  
> Am 24.07.2011 17:05, schrieb David T. Lewis:
> >  
> > On Sun, Jul 24, 2011 at 04:41:50PM +0200, Hans-Martin Mosner wrote:
> >>  
> >> Hello,
> >> quite some time ago (early 2010) I posted an issue on mantis about the linux VM's handling of files > 2GB.
> >> I don't remember whether I sent a report on the list, too, but in any case, current VMs still have the problem.
> >> IIRC, I had a half-working solution at that time, but I'm not sure what the right way is for getting this problem solved
> >> now.
> >> Could anybody please have a short look at this? It would be great if future VMs would be able to handle files of this
> >> size (many video files are bigger than that limit.)
> > Hans-Martin,
> >
> > The Mantis report is <http://bugs.squeak.org/view.php?id=7522>. I just
> > assigned it to myself (it had previously been unassigned, sorry).
> >
> > You mention that you had a half-working solution last year. Can you
> > describe the approach or post some code if you still have it?
> >
> > Thanks,
> > Dave
> >
> >
> I've looked at the files, and I think I was unsure at the time where to put the changes.
> There is a preprocessor define __USE_FILE_OFFSET64 , which should be defined
> pretty much before other linux include files will be read, so that off_t will be defined as __off64_t.
> I do not remember whether I tried to define that in the makefile and got problems in the make process,
> so I moved it into selected header or C files, or whether I directly started with the files - in any case, I think I did
> not get a fully working VM.
>
> I can try to set up a working build environment with VMMaker and everything, however, I don't know
> whether I will have time to do that before my vacation next week.

Thanks. I think that your vacation is the higher priority issue ;-)

I note that googling "largefile LFS gcc linux" seems to turn up
some relevant explanations.

Dave