Go Back   Forum Care Forums > Development Reference Area > Php Development

Reply
 
LinkBack Thread Tools Display Modes
uploading really big files
Old
  (#1)
Angelo Zanetti
Guest
 
Posts: n/a
Default uploading really big files - 06-02-2007, 08:56 PM

Dear all

We need to develop a system where we can upload really big files. IE 15
- 25 Mb.
So I know you can set the limit of the upload thats not a problem, I
know a problem that we might experience is that the browser might time
out. Is there any way around this? and also are there other problems I
might encounter?

Thanks in advance

angelo
--
------------------------------------------------------------------------
Angelo Zanetti
Systems developer
------------------------------------------------------------------------

*Telephone:* +27 (021) 469 1052
*Mobile:* +27 (0) 72 441 3355
*Fax:* +27 (0) 86 681 5885
*
Web:* http://www.zlogic.co.za
*E-Mail:* EMAIL REMOVED <private.php?do=newpm&u=>
   
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote

Re: [PHP] uploading really big files
Old
  (#2)
Tijnema
Guest
 
Posts: n/a
Default Re: [PHP] uploading really big files - 06-02-2007, 08:56 PM

On 5/30/07, Angelo Zanetti <EMAIL REMOVED> wrote:
> Dear all
>
> We need to develop a system where we can upload really big files. IE 15
> - 25 Mb.
> So I know you can set the limit of the upload thats not a problem, I
> know a problem that we might experience is that the browser might time
> out. Is there any way around this? and also are there other problems I
> might encounter?
>
> Thanks in advance
>
> angelo


I wouldn't recommend uploading big files through the browser, as the
HTTP protocol isn't designed for that. FTP is designed for that, and
if you can, use it

I have uploaded really big files with my browser, which sometimes take
several days to complete, and didn't time out, so I don't think it
will be a problem with relative new browsers. (I did with IE6, later
with FireFox on linux)

But, it's very annoying when you're at 90% of upload and your Internet
connection hangs for a few seconds, as that would kill the upload
process and you need to start over again.
If you have a lot of uploads at the same time, it might get your
system out of resources, as all uploads are stored in the RAM while
the user is uploading. So, if you have 100 people uploading, and they
all have already uploaded 10 MB of their file, you would have 1000MB
allocated. In contrast with FTP, as FTP will store the uploads
directly to the drive.

Tijnema
   
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Re: [PHP] uploading really big files
Old
  (#3)
Guest
Guest
 
Posts: n/a
Default Re: [PHP] uploading really big files - 06-02-2007, 08:56 PM

2007. 05. 30, szerda keltezéssel 15.47-kor Angelo Zanetti ezt ÃÂ*rta:
> Dear all
>
> We need to develop a system where we can upload really big files. IE 15
> - 25 Mb.
> So I know you can set the limit of the upload thats not a problem, I
> know a problem that we might experience is that the browser might time
> out. Is there any way around this? and also are there other problems I
> might encounter?


http://www.php.net/manual/en/ref.inf...execution-time

hope that helps
Zoltán Németh

>
> Thanks in advance
>
> angelo
> --
> ------------------------------------------------------------------------
> Angelo Zanetti
> Systems developer
> ------------------------------------------------------------------------
>
> *Telephone:* +27 (021) 469 1052
> *Mobile:* +27 (0) 72 441 3355
> *Fax:* +27 (0) 86 681 5885
> *
> Web:* http://www.zlogic.co.za
> *E-Mail:* EMAIL REMOVED <private.php?do=newpm&u=>
>

   
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Re: [PHP] uploading really big files
Old
  (#4)
Richard Lynch
Guest
 
Posts: n/a
Default Re: [PHP] uploading really big files - 06-02-2007, 08:56 PM

On Wed, May 30, 2007 8:47 am, Angelo Zanetti wrote:
> We need to develop a system where we can upload really big files. IE
> 15
> - 25 Mb.


You're pushing the limit on user patience and browser timeouts...

> So I know you can set the limit of the upload thats not a problem, I
> know a problem that we might experience is that the browser might time
> out. Is there any way around this?


Nope.

The browser gets tired of waiting around for the upload to complete
because your server is too slow/busy, and the user has a very bad
experience.

file upload was grafted onto HTTP rather late in the game, and shows
the scars badly.

> and also are there other problems I
> might encounter?


Woof.

Yes, there are many problems you might encounter :-)

Users on slow/flaky connectionns will never have a good experience
with HTTP file upload. Give them FTP or SCP or something that is more
stable and will re-try.

You also have to consider what users might choose to upload that is
not what you wanted. There are all kinds of people out there looking
to upload "interesting" content that you don't actually want, most
likely.

There is a Flikr book out there that might have some insight for you.
They obviously dealt with this already, and wrote a whole book all
about Flikr, so it's probably got something in there covering this.

--
Some people have a "gift" link here.
Know what I want?
I want you to buy a CD from some indie artist.
http://cdbaby.com/browse/from/lynch
Yeah, I get a buck. So?
   
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Re: [PHP] uploading really big files
Old
  (#5)
Angelo Zanetti
Guest
 
Posts: n/a
Default Re: [PHP] uploading really big files - 06-02-2007, 08:56 PM



Richard Lynch wrote:
> On Wed, May 30, 2007 8:47 am, Angelo Zanetti wrote:
>
>> We need to develop a system where we can upload really big files. IE
>> 15
>> - 25 Mb.
>>

>
> You're pushing the limit on user patience and browser timeouts...
>
>
>> So I know you can set the limit of the upload thats not a problem, I
>> know a problem that we might experience is that the browser might time
>> out. Is there any way around this?
>>

>
> Nope.
>
> The browser gets tired of waiting around for the upload to complete
> because your server is too slow/busy, and the user has a very bad
> experience.
>
> file upload was grafted onto HTTP rather late in the game, and shows
> the scars badly.
>
>
>> and also are there other problems I
>> might encounter?
>>

>
> Woof.
>
> Yes, there are many problems you might encounter :-)
>
> Users on slow/flaky connectionns will never have a good experience
> with HTTP file upload. Give them FTP or SCP or something that is more
> stable and will re-try.
>
> You also have to consider what users might choose to upload that is
> not what you wanted. There are all kinds of people out there looking
> to upload "interesting" content that you don't actually want, most
> likely.
>
> There is a Flikr book out there that might have some insight for you.
> They obviously dealt with this already, and wrote a whole book all
> about Flikr, so it's probably got something in there covering this.
>
>

thanks for the replies. But how does a site like:
http://www.yousendit.com/ do the upload of really huge files?
Normal upload?

thanks

--
------------------------------------------------------------------------
Angelo Zanetti
Systems developer
------------------------------------------------------------------------

*Telephone:* +27 (021) 469 1052
*Mobile:* +27 (0) 72 441 3355
*Fax:* +27 (0) 86 681 5885
*
Web:* http://www.zlogic.co.za
*E-Mail:* EMAIL REMOVED <private.php?do=newpm&u=>
   
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Re: [PHP] uploading really big files
Old
  (#6)
Angelo Zanetti
Guest
 
Posts: n/a
Default Re: [PHP] uploading really big files - 06-02-2007, 08:56 PM



Zoltán Németh wrote:
> 2007. 05. 30, szerda keltezéssel 15.47-kor Angelo Zanetti ezt ÃÂ*rta:
>
>> Dear all
>>
>> We need to develop a system where we can upload really big files. IE 15
>> - 25 Mb.
>> So I know you can set the limit of the upload thats not a problem, I
>> know a problem that we might experience is that the browser might time
>> out. Is there any way around this? and also are there other problems I
>> might encounter?
>>

>
> http://www.php.net/manual/en/ref.inf...execution-time
>
>

yes it does!

thanks

cheers

>
>
>


--
   
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Re: [PHP] uploading really big files
Old
  (#7)
Dimiter Ivanov
Guest
 
Posts: n/a
Default Re: [PHP] uploading really big files - 06-02-2007, 08:56 PM

On 5/30/07, Angelo Zanetti <EMAIL REMOVED> wrote:
> Dear all
>
> We need to develop a system where we can upload really big files. IE 15
> - 25 Mb.
> So I know you can set the limit of the upload thats not a problem, I
> know a problem that we might experience is that the browser might time
> out. Is there any way around this? and also are there other problems I
> might encounter?
>
> Thanks in advance
>
> angelo
> --


I've recently followed this example, for a internal use only upload.
It is for ASP but you can easily modify it for PHP.
You may find it useful, but i can't recommend it over ftp:

http://www.codeproject.com/useritems/AJAXUpload.asp

The one of the limitations of this method is that its IE only. And
also you need to made some registry changes in the clients for it to
work, and then it gets ugly.
But hey, take a look
   
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Re: [PHP] uploading really big files
Old
  (#8)
Richard Lynch
Guest
 
Posts: n/a
Default Re: [PHP] uploading really big files - 06-02-2007, 08:56 PM

On Thu, May 31, 2007 5:07 am, Angelo Zanetti wrote:
> thanks for the replies. But how does a site like:
> http://www.yousendit.com/ do the upload of really huge files?
> Normal upload?


I guess they've already worked through all the issues, ***uming their
service actually works...

Or, perhaps, they don't really care about users on slow/flaky
connections, and simply refund anybody who is unhappy.

I dunno.

Ask them. :-)

--
Some people have a "gift" link here.
Know what I want?
I want you to buy a CD from some indie artist.
http://cdbaby.com/browse/from/lynch
Yeah, I get a buck. So?
   
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Re: [PHP] uploading really big files
Old
  (#9)
Alexander Jaeger
Guest
 
Posts: n/a
Default Re: [PHP] uploading really big files - 06-02-2007, 10:08 PM


> Depends who is doing the uploading...
>
> One also could imagine a write-only account, either in FTP or SCP setup.
>
> I know I've seen this in FTP, and I don't see any reason SCP couldn't.
>
>

the reason why scp is different is it needs an system account with a
valid shell.
FTP does simply not (but it can .

I think nobody except the root user should have shell access to a server,
only for security reasons.

>> -> *Flash *:
>> There a lot of Tutorials out there, try google or sourceforge.
>>

>
> Leaves all your non-Flash users out in the cold, which to me is a
> non-starter, but might be fine for the OP
>
>

There I totaly agree with you! But I require my user to have flash, same
as i require them to have an graphical browser.

I can imagine where the internet would be with still browsing with lynx,
but i guess that is a decision every developer has to face.

I guess the gap is between introducing people how to handle a ftp or scp
transfer and installing flash.

I would go with the second choice.

Nevertheless, i see your point.

Thanks,
Alex

   
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Re: [PHP] uploading really big files
Old
  (#10)
Richard Lynch
Guest
 
Posts: n/a
Default Re: [PHP] uploading really big files - 06-04-2007, 01:37 AM

On Sat, June 2, 2007 3:01 pm, Alexander Jaeger wrote:
>> Depends who is doing the uploading...
>>
>> One also could imagine a write-only account, either in FTP or SCP
>> setup.
>>
>> I know I've seen this in FTP, and I don't see any reason SCP
>> couldn't.
>>
>>

> the reason why scp is different is it needs an system account with a
> valid shell.
> FTP does simply not (but it can .
>
> I think nobody except the root user should have shell access to a
> server,
> only for security reasons.


Veering off the original topic quite a bit here, but...

I personally would refuse to work with any webhost who didn't give me
a shell account.

cron jobs, symlinks, large-scale file operations, and other
innumerable minor reasons make non-ssh web development a royal PITA
for me, personally.

So root-only shell is way too restrictive, imho.

>>> -> *Flash *:
>>> There a lot of Tutorials out there, try google or
>>> sourceforge.
>>>

>>
>> Leaves all your non-Flash users out in the cold, which to me is a
>> non-starter, but might be fine for the OP
>>
>>

> There I totaly agree with you! But I require my user to have flash,
> same
> as i require them to have an graphical browser.
>
> I can imagine where the internet would be with still browsing with
> lynx,
> but i guess that is a decision every developer has to face.


Ummmmm.

I tend to use Linux as my desktop, and gave up on Flash long ago.

Once I stopped installing it on Windows, I had a MUCH better online
experience, actually.

Websites are faster, no annoying random noises and fewer distracting
"popups" and the CPU and RAM usage finally is reasonable.

So I can't listen to bands on myspace. big deal.

> I guess the gap is between introducing people how to handle a ftp or
> scp
> transfer and installing flash.


The gap is between a tiny percentage of users who CANNOT install
flash, period.

I don't know of any OS that doesn't have a large ***ortment of FTP
clients available.

--
Some people have a "gift" link here.
Know what I want?
I want you to buy a CD from some indie artist.
http://cdbaby.com/browse/from/lynch
Yeah, I get a buck. So?
   
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On




Contact Us - Forum Care Forums - Archive - Top