USB Flash Drive, ThumbDrive FAQ

18 February 2008, Comments: 22

A flash drive is a small external USB storage device that reads and writes to flash memory, a solid-state storage medium that’s both inexpensive and durable. Given that your typical flash drive is the size of an adult’s thumb, it’s not uncommon to hear of these ubiquitous devices as “thumb drives”.

It should be noted that while newer Solid State Drives (SSDs) share the flash memory medium with USB thumb drives and sometimes come equipped with a USB interface, many prefer to keep the two terms distinct from one another due to the large differences in physical size, speed, and price.

What are different kinds of flash drives?

There are many types of flash drives available to suit all different kinds of use, but to keep things simple we’ll break things down into five different categories – generic, high performance, ultra durable, secure, and novelty. Keep in mind that these categories are not all mutually exclusive. For example, a secure flash drive with hardware encryption may also be durable enough to withstand the crushing forces of a Honda Accord.

What we like to think of as generic flash drives are the most common type sold, build for economy and raw capacity but not necessarily speed, and almost always encased in plastic. With the exception of a few manufacturers, just about any flash drive with a product name that doesn’t have a Mountain Dew-inspired suffix like Express, GT, GTR, Ultimate, or Ultra will typically fall into this category. Likewise, any product that has such a suffix or is labeled as a high-end model would fall into our high performance category and will employ higher-binned flash memory chips, USB 3.0 and/or better memory controllers to increase transfer speeds.

Ultra durable flash drives can be either fast or slow, but are by far the most fun to review because we get to beat the crap out of them, all in the name of journalism! These can be encased either in rubber to protect against impacts (as shown in the video), and they may or may not have a watertight seal for the USB cap. Depending on the design, manufacturer’s claims, and your definition of common sense, these babies can withstand drops/throws from the top of a building to a concrete surface below, are more likely to survive several rounds in the washer and dryer (if allowed ample time to dry before use), laugh at the notion of being baked in an oven, and love to be submerged at the bottom of a diving pool. Better still, some can deflect bullets up to a .50 caliber, or withstand the almighty crushing forces of Honda automobiles.

Secure flash drives are ones that provide hardware encryption for ensuring the confidentiality and integrity of the stored data. These drives employ an onboard co-processor to handle the encryption algorithms, thus allowing the drive to maintain moderate read and write speeds compared to generic drives used with software encryption utilities. A secure flash drive’s authentication method of choice can vary from a simple username and password logon to more secure biometric fingerprint scanners and funky combination locks.

Other secure flash drive features may include self-destruct sequences, tamper-evident designs, and centralized remote management. The U.S. National Institute of Standards and Technology (NIST) has published a document outlining cryptographic security levels in FIPS 140-2 (warning: pdf), and many drive manufacturers that wish to do business with large corporations or government entities will certify their drives against these standards. At the time of this writing, the highest rating achieved by a flash drive is FIPS 140-2 level 3.

Be sure to check the manufacturer’s website for the method of encryption used; we recommend seeking drives with at least 128-bit AES encryption. Also be sure to register your flash drive with the manufacturer in case the drive’s security is defeated and requires a recall or software update. In early 2010, Kingston, SanDisk, and Verbatim all had to recently face the music when their FIPS 140-2 Level 2 drives were cracked by a German security firm.

Novelty flash drives, last but not least, include any drive that stands out from the rest of the crowd either through the design or the inclusion of bundled features. A few conservative examples would be insanely small and key-shaped drives, split-drive, funky drive covered with Swarovski, beer drives, Mini Cooper, Darth Vader-lookalike flash drive, or a pair of sticks disguised as Swiss Army knife.

Some of the more offbeat examples include gang signs, chain-saw, Transformers, hacked cable, and last but not least, a pair of Dr. Marten’s boots.

Why not use a portable hard drive instead of a flash drive?

Whereas most portable hard drives employ magnetic hard disks with moving parts that can easily break, flash drives are much more durable thanks to their solid state nature, having been known to survive drops of 6′ or more on a routine basis and can even survive a load or three in the laundry. A flash drive is also much easier to pocket than a portable hard drive and can attached to a lanyard or keychain, plus they can be significantly less expensive if only a basic model is needed.

Quite simply put, shoppers primarily concerned with storage capacity should stick to portable hard drives for the cheaper cost per GB, while anyone looking to simply move a few office documents, MP3s or handful of movies around from place to place is going to be better served by the portability and durability that is a USB flash drive.

How fast are flash drives?

This mostly depends on when the drive was released and what memory was being used from which manufacturer, but currently the fastest USB 2.0 flash drives on the market are able to reach read and write speeds of up to 34 and 28MB/s respectively. Typically the manufacturer-listed flash drive speeds only apply to transfers of large contiguous files, whereas smaller files less than 1MB in size can dramatically slow down transfer rates due to the overhead for each file. Actual speeds are also largely dependent on the USB controller of your motherboard and how many USB devices are simultaneously plugged in.

Older high performance drives up to 16GB in size often use what’s known as Single-Level Cell (SLC) memory instead of the more-common Multi-Level Cell (MLC) memory, thereby boosting write speeds for smaller files while simultaneously boosting a flash drive’s endurance level. SLC memory is more expensive to implement however and offers less storage capacity for the die area, and over time has lost significant interest from semiconductor fabs like Samsung as consumer demand for larger flash drives increases. To make up for the loss of SLC memory, flash drive manufacturers have implemented a number of tricks including the use of quad-channel dual controllers and to a lesser extent custom drivers.

What should I format my flash drive as?

This largely depends on your intended use for the drive. Most thumb drives come pre-formatted as FAT32 for cross-platform compatibility with Windows, Mac, and Linux compatibility. Unfortunately this formatting scheme limits the size of any given file to 4GB, so you’ll find that some high definition videos, databases, or secure file vaults won’t fit with this formatting type unless they’re first placed into a multi-volume archive with a utility such as WinRAR or 7-zip.

If you want to avoid this 4GB limit, we recommend reformatting the flash drive to NTFS, which allows for larger file sizes and also offers much improved reliability. NTFS is natively supported by all versions of Windows since NT / 2000, and is also available on Mac and Linux thanks to the NTFS-3G project. Most Linux distributions made within the last year already have NTFS-3G installed and ready to go; Mac users already have Read-Only support built into the operating system but will need to install either the free Catacombae driver or the commercial Tuxera NTFS for Mac driver if write support is needed. Unfortunately, NTFS is not yet supported by many embedded devices such as televisions or media players due to the fact that NTFS is a proprietary system owned by Microsoft and requires licensing.

Another recent development is the exFAT file system, a format that’s optimized for flash drives and currently available on all Windows operating systems since Vista SP1. Windows XP / 2003 users can add experimental support for exFAT by installing KB955704. exFAT improves on the limitations of FAT32 and removes the dreaded 4GB file size limit without the added overhead of NTFS, however we are hesitant to recommend it because at this time it cannot be used with Mac or Linux, and again is incompatible with most embedded devices.

How can I keep the data on my flash drive secure?

While the best security (and speed) often comes from hardware-secured flash drives with their built-in cryptologic co-processors, anyone can secure their regular flash drive through the use of a free open source program called TrueCrypt. TrueCrypt offers a large array of encryption algorithms to choose from including 256-bit AES, Serpent and TwoFish, or any combination of all three, and is available for Windows, Mac and Linux operating systems.

If TrueCrypt is installed on the host machines you plan on using the flash drive with, it’s possible to put a single large file on the flash drive that houses all your encrypted data. This file has built-in plausible deniability – you can’t tell it’s a TrueCrypt file until its mounted, and if required to divulge the password, you can provide a second password that unlocks a different portion of the encrypted volume that’s filled with “safe” data like a fake journal, and there’s no way for anyone to tell that this isn’t what you’re really protecting.

TrueCrypt can also be ran in “portable mode” with the binaries for encryption and decryption kept on the flash drive itself, although this would give away the fact that you’re housing a TrueCrypt volume on the flash drive. The caveat to this is that you’ll need administrator privileges for any computer you plan on using to access the TrueCrypt volume.

An alternative to TrueCrypt is Microsoft’s BitLocker To Go, a full-disk flash drive encryption technology that’s limited to Windows 7 Enterprise and Ultimate editions and Windows Server 2008 R2. Unlike TrueCrypt, BitLocker To Go doesn’t require administrative rights to install or use, and if your workplace likes to stay on the bleeding edge of tech, it may already be widely accessible to you. BitLocker uses AES 128/256-bit encryption.

Unlike TrueCrypt, BitLocker does not have plausible deniability, and Microsoft actively aids law enforcement with recovery in certain scenarios. In a nutshell, don’t leave your computer running because the encryption keys are stored in RAM and can be accessed using forensic software. This is a vulnerability shared by many drive encryption programs and should not be viewed as actually cracking BitLocker. In an enterprise environment, if the volume recovery keys are stored in Active Directory and the system administrator has loose lips or gets handed a subpoena by the authorities, you’re boned. Cryptome hosts a copy of Microsoft’s BitLocker lawful spying guide on their website if you’re interested; search for “win7-bit-spy”.

Remember, there’s no way to keep your data 100% secure if the computer you’re using has been compromised, so be cautious of accessing your private data at public computers like those in a PC cafe. Also, Randall Munroe over at xkcd raises a very valid point in that the weakest link in security is always the human factor.

Why shouldn’t I pick up any flash drive I see lying in the parking lot?

Flash drives left unattended in a parking lot may be a part of a sophisticated social engineering attack. These drives may be seeded with a trojan horse set to automatically run as soon as the drive is inserted and quietly steal your personal or company information in the background. Proof of concepts exist with the USB Switchblade and USB Hacksaw projects, and similar methods have also been used in penetration tests against a credit union and in an actual attack against the U.S. Pentagon!

If you do happen to encounter a stray flash drive and have the unrelenting itch to use it, first, make sure you’ve disabled autorun on your computer. Next, access the drive from within a sandboxed environment such as VMware or the freeware VirtualBox, and make sure that if it’s a U3 drive, the virtual CD ROM partition isn’t compromised. If it is, you’re better off simply destroying the drive. Next, check the data partition for viruses. If you suspect there might be any, you’ll want to format the drive. Congratulations on your newly found (and unpaid for) flash drive!

Keep in mind that not all misplaced flash drives are out to get you. Some might actually be lost and sought after by their owners. Others could be part of an elaborate marketing promotion as was the case with Nine Inch Nails’ Year Zero alternate reality game, ultimately leading to free private concerts. Always use your best judgment and caution.

Help! How do I recover files accidentally deleted from my flash drive?

Stop whatever it is you’re doing, don’t write anything to the flash drive, and Recuva that file for free!! From the makers of CCleaner, Piriform’s Recuva is a donationware utility that’s able to rescue data on hard drives and flash drives formatted as FAT, exFAT, and NTFS.

Having personally tested this app on an 8GB flash drive formatted as NTFS, we were happy to see it successfully recover not only files that were recently deleted in Windows Explorer, but also files that were lost after a complete reformat through the deep scan functionality. Unfortunately, the files lost to reformatting were without their original file names, though the actual data was 100% intact. Be warned however that the program is not likely to restore data that’s fragmented and doesn’t reside in the drive’s MFT, or data that’s been overwritten over by new data.

Though typically installed on a fixed hard disk in case of future disaster, Piriform also offers the program in a U3 or generic portable version that can be installed to and ran from a flash drive.

Can I boot my computer from a USB flash drive?

Yes! A bootable flash drive can be the ultimate tool for recovering a downed computer, or perhaps your easiest means of upgrading a netbook’s operating system without a CD-ROM drive. Because there’s so many potential uses and ways to make a flash drive bootable, unfortunately we won’t be able to go in depth for the purposes of this FAQ. To get you started in the right direction, however, here’s a handful of scenarios and their associated walkthroughs that we feel are well-written and easy to follow.

  • Boot the Ultimate Boot CD (UBCD) repair tools from a flash drive
  • Boot Clonezilla (Norton Ghost alternative) from a flash drive
  • Boot / Install Ubuntu 9.10 Linux from a flash drive
  • Boot Windows XP from a flash drive
  • Boot Windows 7 from a flash drive
  • Install Windows 7 from a flash drive
What is ReadyBoost and why should I (not) care?

ReadyBoost is an advanced disk caching technique tied into Windows Superfetch for Windows Vista and Windows 7. It can dramatically speed up the performance of computers with little RAM, especially those with 1GB or less. Because flash memory is able to handle random non-sequential reads faster than a conventional hard drive would, it’s better suited for caching small bits of data while larger chunks are still left to the hard drive’s faster throughput.

ReadyBoost can be activated on any flash drive greater than 256MB in size, provided that the USB flash drive can manage at least 2.5MB/s for random 4kB reads and at least 1.75MB/s for random 512kB writes. Nearly all high performance flash drives meet this requirement, and some are even labeled to show they’re enhanced for ReadyBoost. On Vista, up to 4GB can be used for ReadyBoost caching, whereas on Windows 7 there is no limit. Any cached files written to the flash drive are both compressed and encrypted with 128-bit AES.

An alternative to ReadyBoost that’s similar in concept is the third-party eBoostr utility, whose main draw is that it works with Windows XP and Windows 2000 whereas ReadyBoost doesn’t.

The reason we don’t particularly care for ReadyBoost and company is because flash drives have a limited number of write cycles and wear down over time; these utilities only make the process go that much quicker. Also, ReadyBoost’s performance pales in comparison to the simple alternative of buying more RAM. And why not? RAM is incredibly cheap nowadays and super easy to install. Seriously… if there’s one component that’s always been user upgradeable in any locked down Dell, HP or Gateway system, it’s been the memory. If you’re still too scared to open the case, have your cat do it.

  •  
  •  
  •  
  •  
  •  
  •  
  •  
  •  

  • http://pulse.yahoo.com/_CCYY74IEDLDGS2Y7C3MVAI6MRY Benny

    Currently, I just bought 2 flash drives or thumb drives from Thailand with a capacity of 64 GB and 512 GB. But the problem here is that when I save certain documents or information into it and once it has properly being ejected out and when the next time I put it in again, some information is lost. I have tried reformatting several times and it still the same outcome. Please advise. Thanks. Benny

    • Zach Hoy

      Sorry, but you bought fake USB drives. 128GB drives are over $200US. Although a 1TB drive has been made (
      http://blog.premiumusb.com/2012/01/update-worlds-largest-usb-flash-drive/), the price for anything above 256GB is prohibitive.
      Your USB drive will report 512GB of capacity, but that’s duplicitous. It’s probably only 4 or 8 or something weird like 5.6gb. It’s essentially useless because the controller will try to write to non-existent clusters. 

  • http://www.bootland.nl/ bootland.nl

    Where can I find the test results with flash drives? I am specifically interested in the LaCie ones.

  • Matthew Howe

    I have a tablet it has a nice microSD slot it uses for an HDD. You can also take the tablet apart and replace this microSD with a larger one. IS is possible to take the microSD slot holder off and insted hardwire a usb drive to be used in its place?

  • Zolar Google

    you might have a compression type flash drive. I have a Sony Vault that is 1gb uncompressed but up to 3gb compressed. It comes with both the compressor and decompressor (works only with windows stuff).

    You also could have bought a knock-off thumb drive too.

    If you want a 64gb thumb drive for a reasonable price go to microcenter dot com .

    Not every flash drive is fast enough for ready boost. The manufacturers can claim anything just to get you to buy their products. But in real life, things are quite different and most times quite SLOW.

    Many of them make the drives and rate them by writing all zero’s or 1′s to the drive and measuring the speed. Be lucky if you get 1/2 that in normal use.

    Now, if they wrote a real file say an encyclopedia or even a movie then you would know the real speed. You would need to write and delete this about a dozen times to get a true average.

  • Zolar Google

    You wrote: “Seriously… if there’s one component that’s always been user upgradeable in any locked down Dell, HP or Gateway system, it’s been the memory. If you’re still too scared to open the case, have your cat do it.”.

    This is exactly why I don’t buy brand name computers nor toy computers (AKA laptops and similar).
    You are stuck with what they want you to have. Been there, done that.

    Note: some computer makers will void the warranty if you open the case. And if you install mismatched memory or cheap memory your computer can slow to a crawl.

  • Johbudo

    I am looking for usbs with a latch on the top like this one in the  video  http://www.kickstarter.com/projects/1889936100/boom-binder

    Are there any other options other than verbatium I seem to be having problems.

    thanks
    John

  • http://www.facebook.com/bjktaxman Billy King

    I HAVE NO KNOWLEDGE OF HOW TO TRANSFER FILES OFF ONE COMPUTER AND INSTALL THE INFORMATION ON ANOTHER.CAN YOU HELP?

  • evolet0680

    I need a recommendation for a basic, “store your files here” flash drive. There are apparently a lot of good one, a lot of expensive ones, and a lot of cheap ones which may or may not be total crap. Any suggestions?

  • Ravi

    While all my flash drives can be opened in my PC when I insert them into a USB music player some work others dont. Why?

    • rave le

      make sure the file your trying to open is (.mp3) format. If is and still wouldn’t open, try redownloading it.

      • Ravi

        I have a bunch of (>1500) MP3 songs in my Music folder of the computer. I loaded these into 8 flash drives (Sandisc 4 GB). First I copied them into NTFS file format duly formatting them and when it failed again to FAT 32 file format. All these 8 play normally in my PC but when I insert them in my AIWA music player out of 8, 3 or 4 play normally but others are not recognized or read by my player. Any clues?

        • rave le

          put your files in you cpu in one folder, or put your music in by bundles.

          • Ravi

            Well am glad I was able to solve this issue. Here it is:
            (1) Connect Flash drive. (2) Transfer all songs back to PC (3) Right click the flash drive from My Computer (4) Select ‘Format’ (5) select FAT (DEFAULT) …not FAT32 or any other options (6) click button ‘Default for this drive’ (7) Format the drive (8) Then copy back all the songs

  • sitesh

    Hi,
    I have a flash drive which have 4 Gb space available. I want 2GB to be non formatable which includes images and videos. And the other remaining 2GB space I want to make it formatable. Need a favour!!

  • Anne Clark

    I haven’t been able to find an answer to this. I need a high speed usb 2.0 flash memory drive. If I get a 3.0 drive, will it operate at maximum 2.0 speeds?

  • David Wilson

    Why are USB2 flash drives still being manufactured, when USB 3 is backwards compatible?

    USB standard has been out now for a few years, and yet most products are still USB2. That is a stupid state of affairs!

  • Tammy

    Novelty flash drives (customized webkeys) are great for business advertising and branding. See http://www.paperwebkey.ca/ for examples.

  • Scorpio012

    Please be patient when you read my question as I am very computer illiterate. Some time ago I had bought one of those Sandisk 4GB flash drives and plugged into the back of my computer. Recently I had to take my computer into a shop for some other work and the tech removed the flash drive from the back and handed it to me. After I got the computer home I wasn’t sure if I need to plug the flash drive back in? Not knowing exactly how they work is the reason I ask. If they store information on them will the information be lost until I plug the flash drive back in? Thanks

  • Amber Madden

    I use a flash drive once a week to backup Quick Books. I send the flash drive to the home office where the VP then restores it to her system. After she is finished with it, she backs it up on the same drive and sends it back to me. I then restore it. I have been reprimanded for doing it wrong… a couple times the data amount I back up is slightly smaller than the amount that was backed up from the home office. Am I loosing data or is this due to compression of files?

    • Ian Chiu

      This could have something to do with QuickBooks. You two are probably entering numbers and text exclusively which are highly compressible. Have you verified the data integrity? Also, do you and the VP use the same version of Windows?

      These days, it’s probably better to use service like Google Drive and DropBox if you are exchanging the files on a regular basis. Files are more accessible if they are not BIG, and there are options to use file history as precaution if you need to roll back. Of course you would want to password protect your QuickBooks before “sharing” it online.

  • Banzee Simmons

    Recently my friend took my pendrive to his class and he needed to take some files from him class mate.. so to fit in those files, he formatted the entire drive and then added files of his.. My pendrive was of 8GB and it was full with 7.5GB of data and to add 700 MB of his files, he formatted all of them..

    Now I need those files back as they contained live class footage of an important subject.
    I tried a few data recovery software and the best I got was around 70% of original files with Stellar Phoenix Photo Recovery that I downloaded from http://www.retrievephotos.com/.. with neither of the software giving better performance than this.. But I am not happy with this..

    After asking on a few forums, they said that I will be getting this much only as rest of the files could have been overwritten and you are lucky to get this much..

    Do you have any suggestion what I should do? Any other means to recover those files.