Smalltalk › Cincom › VisualWorks

any way to cache DTDs?

_‹ Previous Topic Next Topic _›

Classic

List

Threaded

14 messages Options

Travis Griggs

any way to cache DTDs?

I have a bunch of XML files to parse/process. 317 of them. They each
have a DTD that points out across the net. So parsing each one takes
nearly 5 seconds. Mostly in network IO. But the DTD is always the
same. Is there anyway to somehow "prime" an XMLParser so I only have
to do this once, not 317 times.

--
Travis Griggs
Objologist
One man's blue plane is another man's pink plane.

-----------------------------------------
DISCLAIMER: This email is bound by the terms and conditions
described at
http://www.key.net/disclaimer.htm

Georg Heeg

AW: any way to cache DTDs?

Travis,

Load SpeedupXMLParser.pcl from you VisualWorks distribution. You will find
it in contributed\heeg.

Georg

-----Ursprüngliche Nachricht-----
Von: Travis Griggs [mailto:[hidden email]]
Gesendet: Mittwoch, 15. Februar 2006 19:42
An: VW NC
Betreff: any way to cache DTDs?

I have a bunch of XML files to parse/process. 317 of them. They each
have a DTD that points out across the net. So parsing each one takes
nearly 5 seconds. Mostly in network IO. But the DTD is always the
same. Is there anyway to somehow "prime" an XMLParser so I only have
to do this once, not 317 times.

--
Travis Griggs
Objologist
One man's blue plane is another man's pink plane.

-----------------------------------------
DISCLAIMER: This email is bound by the terms and conditions
described at
http://www.key.net/disclaimer.htm

Boris Popov, DeepCove Labs (SNN)

RE: any way to cache DTDs?

In reply to this post by Travis Griggs

Do you happen to have SpeedupEverythingElse.pcl as well by any chance?

;)

-Boris

--
+1.604.689.0322
DeepCove Labs Ltd.
4th floor 595 Howe Street
Vancouver, Canada V6C 2T5

[hidden email]

CONFIDENTIALITY NOTICE

This email is intended only for the persons named in the message
header. Unless otherwise indicated, it contains information that is
private and confidential. If you have received it in error, please
notify the sender and delete the entire message including any
attachments.

Thank you.

> -----Original Message-----
> From: Georg Heeg [mailto:[hidden email]]
> Sent: Wednesday, February 15, 2006 10:51 AM
> To: 'Travis Griggs'; 'VW NC'
> Subject: AW: any way to cache DTDs?
>
> Travis,
>
> Load SpeedupXMLParser.pcl from you VisualWorks distribution.
> You will find it in contributed\heeg.
>
> Georg
>
> -----Ursprüngliche Nachricht-----
> Von: Travis Griggs [mailto:[hidden email]]
> Gesendet: Mittwoch, 15. Februar 2006 19:42
> An: VW NC
> Betreff: any way to cache DTDs?
>
> I have a bunch of XML files to parse/process. 317 of them.
> They each have a DTD that points out across the net. So
> parsing each one takes nearly 5 seconds. Mostly in network
> IO. But the DTD is always the same. Is there anyway to
> somehow "prime" an XMLParser so I only have to do this once,
> not 317 times.
>
> --
> Travis Griggs
> Objologist
> One man's blue plane is another man's pink plane.
>
>
>
> -----------------------------------------
> DISCLAIMER: This email is bound by the terms and conditions
> described at http://www.key.net/disclaimer.htm
>
>
>

smime.p7s (4K) Download Attachment

Georg Heeg

AW: any way to cache DTDs?

Boris,

Surely I do. On the CD you find SpeedUpMessageCatalogs also. Just last week
we developed a speedup for loading and unloading called
SuppressSuperfluousUpdatesInRB.

Georg

-----Ursprüngliche Nachricht-----
Von: Boris Popov [mailto:[hidden email]]
Gesendet: Mittwoch, 15. Februar 2006 19:58
An: Georg Heeg; Travis Griggs; VW NC
Betreff: RE: any way to cache DTDs?

Do you happen to have SpeedupEverythingElse.pcl as well by any chance?

;)

-Boris

--
+1.604.689.0322
DeepCove Labs Ltd.
4th floor 595 Howe Street
Vancouver, Canada V6C 2T5

[hidden email]

CONFIDENTIALITY NOTICE

This email is intended only for the persons named in the message
header. Unless otherwise indicated, it contains information that is
private and confidential. If you have received it in error, please
notify the sender and delete the entire message including any
attachments.

Thank you.

Thomas Gagné-2

Re: any way to cache DTDs?

In reply to this post by Travis Griggs

Travis Griggs wrote:
> I have a bunch of XML files to parse/process. 317 of them. They each
> have a DTD that points out across the net. So parsing each one takes
> nearly 5 seconds. Mostly in network IO. But the DTD is always the
> same. Is there anyway to somehow "prime" an XMLParser so I only have
> to do this once, not 317 times.
>
Yes, there is. You can download a parcel I have that includes DTD
caching code that I got from someone else. I think there's an
attribution in the parcel comments. If you google "smalltalk xml dtd
caching" it's the top choice.

<http://gagne.homedns.org/~tgagne/articles/vwxml.html>

> --
> Travis Griggs
> Objologist
> One man's blue plane is another man's pink plane.
>
>
>
> -----------------------------------------
> DISCLAIMER: This email is bound by the terms and conditions
> described at
> http://www.key.net/disclaimer.htm
>
>

--
Visit <http://tggagne.blogspot.com/>,<http://gagne.homedns.org/> or
<http://gagne.homedns.org/~tgagne/> for more great reading.

Boris Popov, DeepCove Labs (SNN)

RE: any way to cache DTDs?

In reply to this post by Travis Griggs

Is there a petition to integrate all of these in base for once? Surely this
would save you a lot of grief making sure they stay up to date with ever
evolving releases?

Cheers!

-Boris

--
+1.604.689.0322
DeepCove Labs Ltd.
4th floor 595 Howe Street
Vancouver, Canada V6C 2T5

[hidden email]

CONFIDENTIALITY NOTICE

This email is intended only for the persons named in the message
header. Unless otherwise indicated, it contains information that is
private and confidential. If you have received it in error, please
notify the sender and delete the entire message including any
attachments.

Thank you.

> -----Original Message-----
> From: Georg Heeg [mailto:[hidden email]]
> Sent: Wednesday, February 15, 2006 11:02 AM
> To: Boris Popov; 'Travis Griggs'; 'VW NC'
> Subject: AW: any way to cache DTDs?
>
> Boris,
>
> Surely I do. On the CD you find SpeedUpMessageCatalogs also.
> Just last week we developed a speedup for loading and
> unloading called SuppressSuperfluousUpdatesInRB.
>
> Georg
>
> -----Ursprüngliche Nachricht-----
> Von: Boris Popov [mailto:[hidden email]]
> Gesendet: Mittwoch, 15. Februar 2006 19:58
> An: Georg Heeg; Travis Griggs; VW NC
> Betreff: RE: any way to cache DTDs?
>
> Do you happen to have SpeedupEverythingElse.pcl as well by any chance?
>
> ;)
>
> -Boris
>
> --
> +1.604.689.0322
> DeepCove Labs Ltd.
> 4th floor 595 Howe Street
> Vancouver, Canada V6C 2T5
>
> [hidden email]
>
> CONFIDENTIALITY NOTICE
>
> This email is intended only for the persons named in the
> message header. Unless otherwise indicated, it contains
> information that is private and confidential. If you have
> received it in error, please notify the sender and delete the
> entire message including any attachments.
>
> Thank you.
>
>
> > -----Original Message-----
> > From: Georg Heeg [mailto:[hidden email]]
> > Sent: Wednesday, February 15, 2006 10:51 AM
> > To: 'Travis Griggs'; 'VW NC'
> > Subject: AW: any way to cache DTDs?
> >
> > Travis,
> >
> > Load SpeedupXMLParser.pcl from you VisualWorks distribution.
> > You will find it in contributed\heeg.
> >
> > Georg
> >
> > -----Ursprüngliche Nachricht-----
> > Von: Travis Griggs [mailto:[hidden email]]
> > Gesendet: Mittwoch, 15. Februar 2006 19:42
> > An: VW NC
> > Betreff: any way to cache DTDs?
> >
> > I have a bunch of XML files to parse/process. 317 of them.
> > They each have a DTD that points out across the net. So
> parsing each
> > one takes nearly 5 seconds. Mostly in network IO. But the DTD is
> > always the same. Is there anyway to somehow "prime" an
> XMLParser so I
> > only have to do this once, not 317 times.
> >
> > --
> > Travis Griggs
> > Objologist
> > One man's blue plane is another man's pink plane.
> >
> >
> >
> > -----------------------------------------
> > DISCLAIMER: This email is bound by the terms and conditions
> described
> > at http://www.key.net/disclaimer.htm
> >
> >
> >
>
>

smime.p7s (4K) Download Attachment

Travis Griggs

Re: AW: any way to cache DTDs?

In reply to this post by Georg Heeg

On Feb 15, 2006, at 11:01, Georg Heeg wrote:

> Boris,
>
> Surely I do. On the CD you find SpeedUpMessageCatalogs also. Just
> last week
> we developed a speedup for loading and unloading called
> SuppressSuperfluousUpdatesInRB.

Hey and while we're on that note, and speaking of "namesake"
packages... you might check out ExtraCatalogs. It makes Catalog
lookup go _really_ fast :) It makes translators like you more too.

--
Travis Griggs
Objologist
"I think that we should be men first, and subjects afterward." -
Henry David Thoreau

-----------------------------------------
DISCLAIMER: This email is bound by the terms and conditions
described at
http://www.key.net/disclaimer.htm

Charles A. Monteiro-2

Re: any way to cache DTDs?

In reply to this post by Boris Popov, DeepCove Labs (SNN)

now, now , that's just not nice, most things are at least for me more than
fast enough.

On Wed, 15 Feb 2006 13:58:05 -0500, Boris Popov <[hidden email]>
wrote:

> Do you happen to have SpeedupEverythingElse.pcl as well by any chance?
>
> ;)
>
> -Boris
>

--
Charles A. Monteiro

Charles A. Monteiro-2

Re: AW: any way to cache DTDs?

In reply to this post by Georg Heeg

Is all of this wonderful German engineering on the 7.4 commercial CD?

On Wed, 15 Feb 2006 14:01:50 -0500, Georg Heeg <[hidden email]> wrote:

> Boris,
>
> Surely I do. On the CD you find SpeedUpMessageCatalogs also. Just last
> week
> we developed a speedup for loading and unloading called
> SuppressSuperfluousUpdatesInRB.
>
> Georg
>
> -----Ursprüngliche Nachricht-----
> Von: Boris Popov [mailto:[hidden email]]
> Gesendet: Mittwoch, 15. Februar 2006 19:58
> An: Georg Heeg; Travis Griggs; VW NC
> Betreff: RE: any way to cache DTDs?
>
> Do you happen to have SpeedupEverythingElse.pcl as well by any chance?
>
> ;)
>
> -Boris
>

--
Charles A. Monteiro

Georg Heeg

AW: AW: any way to cache DTDs?

Charles,

The two speedup parcels are on the CDs both commercial and NC since a couple
of versions. SuppressSuperfluousUpdatesInRB certainly is not, it is just too
new and with this I have the intension to get it into the base system (AR
48877).

Georg

-----Ursprüngliche Nachricht-----
Von: Charles A. Monteiro [mailto:[hidden email]]
Gesendet: Donnerstag, 16. Februar 2006 15:12
An: Georg Heeg; 'Boris Popov'; 'Travis Griggs'; 'VW NC'
Betreff: Re: AW: any way to cache DTDs?

Is all of this wonderful German engineering on the 7.4 commercial CD?

On Wed, 15 Feb 2006 14:01:50 -0500, Georg Heeg <[hidden email]> wrote:

--
Charles A. Monteiro

Mark Pirogovsky-3

Re: AW: AW: any way to cache DTDs?

That is a great news. I do use few of your tools over the VW provided
ones and I am very happy with them.

Is the SuppressSuperfluousUpdatesInRB published in the public store by
any chance ? and if so in what package ?

TIA,

--Mark

Georg Heeg wrote:
> Charles,
>
> The two speedup parcels are on the CDs both commercial and NC since a couple
> of versions. SuppressSuperfluousUpdatesInRB certainly is not, it is just too
> new and with this I have the intension to get it into the base system (AR
> 48877).
>
> Georg

Travis Griggs

Re: AW: any way to cache DTDs?

In reply to this post by Georg Heeg

On Feb 15, 2006, at 10:51, Georg Heeg wrote:

> Travis,
>
> Load SpeedupXMLParser.pcl from you VisualWorks distribution. You
> will find
> it in contributed\heeg.

FWIW, I blogged about the results of using Georg's Speedup parcel.
Short of it... about 3.5x faster. Thank you Heeg.

--
Travis Griggs
Objologist
"It had better be a pretty good meeting, to be better than no meeting
at all" - Boyd K Packer

-----------------------------------------
DISCLAIMER: This email is bound by the terms and conditions
described at
http://www.key.net/disclaimer.htm

Thomas Gagné-2

Re: AW: any way to cache DTDs?

Did you have any luck loading the DTD caching parcel? My measurements,
with a local DTD, were a 10x improvement.

Travis Griggs wrote:

>
> On Feb 15, 2006, at 10:51, Georg Heeg wrote:
>
>> Travis,
>>
>> Load SpeedupXMLParser.pcl from you VisualWorks distribution. You will
>> find
>> it in contributed\heeg.
>
> FWIW, I blogged about the results of using Georg's Speedup parcel.
> Short of it... about 3.5x faster. Thank you Heeg.
>
> --
> Travis Griggs
> Objologist
> "It had better be a pretty good meeting, to be better than no meeting
> at all" - Boyd K Packer
>
>
>
> -----------------------------------------
> DISCLAIMER: This email is bound by the terms and conditions
> described at
> http://www.key.net/disclaimer.htm
>
>

--
Visit <http://tggagne.blogspot.com/>,<http://gagne.homedns.org/> or
<http://gagne.homedns.org/~tgagne/> for more great reading.

Georg Heeg

AW: AW: any way to cache DTDs?

We built the speedup parcel when we were working on xhtml files. As the DTD
of xhtml is bigger than most html pages and our html pages were all local
files we got also an enormous improvement. As always when you start caching,
the real improvements vary a lot from case to case.

Georg

-----Ursprüngliche Nachricht-----
Von: Thomas Gagné [mailto:[hidden email]]
Gesendet: Donnerstag, 16. Februar 2006 20:04
An: [hidden email]
Cc: VW NC
Betreff: Re: AW: any way to cache DTDs?

Did you have any luck loading the DTD caching parcel? My measurements,
with a local DTD, were a 10x improvement.

Travis Griggs wrote:

--
Visit <http://tggagne.blogspot.com/>,<http://gagne.homedns.org/> or
<http://gagne.homedns.org/~tgagne/> for more great reading.