DotNetNewsgroup.com  
web access to complete list of Microsoft.NET newsgroups
   home   |   control panel login   |   archive  |  
 
  carried group
academic
adonet
aspnet
aspnet.announcements
aspnet.buildingcontrols
aspnet.caching
aspnet.datagridcontrol
aspnet.mobile
aspnet.security
aspnet.webcontrols
aspnet.webservices
assignment_manager
datatools
dotnet.distributed_apps
dotnet.general
dotnet.myservices
dotnet.nternationalization
dotnet.scripting
dotnet.security
dotnet.vjsharp
dotnet.vsa
dotnet.xml
dotnetfaqs
framework
framework.clr
framework.compactframework
framework.component_services
framework.controls
framework.databinding
framework.drawing
framework.enhancements
framework.interop
framework.odbcnet
framework.performance
framework.remoting
framework.sdk
framework.setup
framework.webservices
framework.windowsforms
framework.wmi
frwk.windowsforms.designtime
lang.csharp
lang.jscript
lang.vb
lang.vb.controls
lang.vb.data
lang.vb.upgrade
lang.vc
lang.vc.libraries
  
 
start date: Wed, 1 Aug 2007 20:15:47 -0700,    posted on: microsoft.public.dotnet.framework.aspnet        back       

Thread Index
  1    Jim Bancroft
          2    Alexey Smirnov
                 3    Laurent Bugnion, MVP
                        4    Laurent Bugnion, MVP
                        5    Laurent Bugnion, MVP
          6    Alexey Smirnov
          7    Alexey Smirnov


Iterating and downloading a URL that lists files?   
Is there a way to open a URL, one that shows nothing other than a directory 
listing, and iteratively go through the list to download the files?
Date:Wed, 1 Aug 2007 20:15:47 -0700   Author:  

Re: Iterating and downloading a URL that lists files?   
On Aug 2, 5:15 am, "Jim Bancroft"  wrote:

> Is there a way to open a URL, one that shows nothing other than a directory
> listing, and iteratively go through the list to download the files?


Hi Jim,

you can use a HttpWebRequest with a StreamReader to get the page from
the URL, then the content of the page can be parsed with a regular
expression to get the list of all links and then again use
HttpWebRequest to get the files...

Hope it helps
Date:Thu, 02 Aug 2007 00:08:22 -0700   Author:  

Re: Iterating and downloading a URL that lists files?   
Hi,

Alexey Smirnov wrote:

> On Aug 2, 5:15 am, "Jim Bancroft"  wrote:
>> Is there a way to open a URL, one that shows nothing other than a directory
>> listing, and iteratively go through the list to download the files?
> 
> Hi Jim,
> 
> you can use a HttpWebRequest with a StreamReader to get the page from
> the URL, then the content of the page can be parsed with a regular
> expression to get the list of all links and then again use
> HttpWebRequest to get the files...
> 
> Hope it helps


I did that a long time ago with a Java applet. I then discovered that 
the page format was different in Netscape (back then) and IE. I hope 
things are more standard now!

HTH,
Laurent
-- 
Laurent Bugnion [MVP ASP.NET]
Software engineering, Blog: http://www.galasoft.ch
PhotoAlbum: http://www.galasoft.ch/pictures
Support children in Calcutta: http://www.calcutta-espoir.ch
Date:Thu, 02 Aug 2007 10:50:26 +0200   Author:  

Re: Iterating and downloading a URL that lists files?   
On Aug 2, 10:50 am, "Laurent Bugnion, MVP" 
wrote:


> the page format was different in Netscape (back then) and IE. I hope
> things are more standard now!


Laurent, do you mean that the default directory listing depends on the
client browser? It depends on a web server and not on a browser. I
have no example for IIS, but here's the one for Apache

Default settings:
http://tomcat.apache.org/tomcat-6.0-doc/default-servlet.html

Example how it looks on the website:
http://cohred.org/cohred/content/

When directory browsing in enabled on a web site and there isn't a
default document available, IIS will display the contents of the
directory as a similar page and it looks the same in IE, and other
browsers
Date:Thu, 02 Aug 2007 03:04:33 -0700   Author:  

Re: Iterating and downloading a URL that lists files?   
Hi,

Alexey Smirnov wrote:

> On Aug 2, 10:50 am, "Laurent Bugnion, MVP" 
> wrote:
> 
>> the page format was different in Netscape (back then) and IE. I hope
>> things are more standard now!
> 
> Laurent, do you mean that the default directory listing depends on the
> client browser? It depends on a web server and not on a browser. I
> have no example for IIS, but here's the one for Apache


Back then, the client browser used to add content to the directory 
listing page. I tested again right now in Firefox and IE, and apparently 
this is not the case anymore, so you're lucky!

I am talking about Netspace 4 and IE4, that was back in... not sure... 
97 maybe?

Anyway, good luck with your project!
Laurent
-- 
Laurent Bugnion [MVP ASP.NET]
Software engineering, Blog: http://www.galasoft.ch
PhotoAlbum: http://www.galasoft.ch/pictures
Support children in Calcutta: http://www.calcutta-espoir.ch
Date:Thu, 02 Aug 2007 13:22:18 +0200   Author:  

Re: Iterating and downloading a URL that lists files?   
On Aug 2, 1:22 pm, "Laurent Bugnion, MVP" 
wrote:

>
> I am talking about Netspace 4 and IE4, that was back in... not sure...
> 97 maybe?


Huh? We are talking about ASP.NET :-)
Date:Thu, 02 Aug 2007 17:59:27 -0000   Author:  

Re: Iterating and downloading a URL that lists files?   
Hi,

Alexey Smirnov wrote:

> On Aug 2, 1:22 pm, "Laurent Bugnion, MVP" 
> wrote:
>> I am talking about Netspace 4 and IE4, that was back in... not sure...
>> 97 maybe?
> 
> Huh? We are talking about ASP.NET :-)


Yeah I was rambling. Your post awoke old nostalgies, sorry :-) I'll shut 
up now. :-)

Laurent
-- 
Laurent Bugnion [MVP ASP.NET]
Software engineering, Blog: http://www.galasoft.ch
PhotoAlbum: http://www.galasoft.ch/pictures
Support children in Calcutta: http://www.calcutta-espoir.ch
Date:Thu, 02 Aug 2007 20:12:53 +0200   Author:  

Google
 
Web dotnetnewsgroup.com


COPYRIGHT ?2005, EUROFRONT WORLDWIDE LTD., ALL RIGHT RESERVE  |   Contact us