HTPC Network

Support, Discussion, Reviews
Post Reply
User avatar
valryte
Almost 1337
Almost 1337
Posts: 679
Joined: August 28, 2002, 12:58 am

HTPC Network

Post by valryte »

For about a 2 years now I've been wanting to set up some sort of file server that would store various media (movies, television shows, home videos, etc...) that I could them stream to any television in my house, specifically my home theater. Everything I investigated always had some major flaw or shortcoming that I just didn't like. You see it's not just about slapping together a file server, there's actually several pieces that need to be put together in terms of hardware and software to being able to do everything that's required from beginning to end in an HTPC network setup. Well about 3 months ago the pieces started to all fall in place and I've finally put together something that really works and works incredibly well.

Storage

The biggest issue you'll run into is free space. How do you continue to grow the storage space easily. The other issues is how do you support redundancy. After all you wouldn't want terabytes of files to simply disappear, especially after going through the trouble of getting the files on there. So now you're looking into raid, but raid controllers have some issues. First they are extremely expensive especially when you're talking about 8+ SATA ports. Secondly, increasing storage space is a real PITA. They usually require a rebuild of the entire array and if you have 5-6 terabytes, plan for a vacation while it's rebuilding. But forget how long it takes, did I mention how freaking expensive the controllers are?

The solution for all these problems is called unRAID.

* Any combination of IDE and SATA hard drives may be used.
* All the hard drives do not need to be the same size or speed.
* Hard drives not being accessed may be spun down.
* Can rebuild any single failed hard drive.

For $119 bucks you get the Pro version which supports up to 20 drives. You can get the free version which supports up to 3-4 drives so you can test it out.

unRAID basically gets copied onto a USB flash drive (I recommend a fast flash drive for quick boot-ups, though it will always be up anyways). While it's Linux based, don't worry it's extremely easy to use as it's all self contained. The most you'll ever really do is maybe modify some config files if you're installing any of the community addons. The way it works is that 1 drive is set as a parity drive (it needs to be as big as the largest drive) The rest of the drives are data drives (can be different sizes). You can have something called a cache drive, but I don't really use one. The parity mechanism is fairly simple, but I won't get into the details (just look on their wiki). I'll just tell you what matters. If you lose the parity drive, you just replace it and rebuild the parity info. If you lose a data drive, you replace it and rebuild the data based using the parity and the data on the drives. If you lose more than 1 drive, well all is not lost like in standard raid. You see the files are actually stored whole on the drives and are simply spread across the multiple drives. So if you lost more than 1 drive, while it won't be able to rebuild it, you will still have the data that is on the other drives. So for example if you were storing movies, you would only lose the movies on the dead drives. It has a configuration for the shares where you can basically tell it to spread the folders (in this example the folders are the names of the movies) across the drives, but keep all the files within that folder together. In the end what you'll have is a NAS that is exposing shares for your media (movies, music, pictures, television, etc...)

As for the addons, the community is pretty good. They have some nice web interfaces that they are working on. There are notifications scripts that will email you if there is a problem with a drive and health of the drives. I get a health report once a day.

This is a SS of one of the custom web interfaces that someone created. The unRAID team is working on an API to make it easier, but without it people have still put together some nice stuff.
Image

From the front you can see the cages that use 120mm fans (very quiet). Each cage can hold 4 drives each.
Image

Image

Here is the front with the bezel on. The 5.25 plates in the front bezel are all perforated and have some cheap filter material, but it definitely keeps the air flowing.
Image

HTPC Software

For the HTPC, the main issue is of course how to play the media from the server on your TV. Well for the OS I just installed Vista and configured it to autologon.

Media Player - XBMC
As for the media software I'm using something called XBMC.
Image
It's a 3rd party media center that was created back in the days of the original xbox (well a hacked one that is). Since then they've ported it to Windows, Linux, and Mac to run as a standalone media center. Let me tell you it runs awesome. The thing can play anything you throw at it except for an actual Bluray disc as there aren't any open source Bluray C++ libraries available yet, but I believe people have it opening using a commercial software Bluray player for windows. I have a standalone BD player so it's a none issue for me.

One of the best features is the built in web scraper engine. Basically it can scrape sites like IMDB, Amazon, TVDB, etc... to pull down movie info (plot, actors, etc...), thumbnails, fan art, etc...which it stores in its libraries. This way when you are scanning your movie/tv library, you can see poster images as you go through the lists.
Image

Image

Image

Another nice thing is that you don't have to worry about organizing your media too much as it has a library mode which lets you list movies by title, genre, actor, etc... It does treat Movies and Television differently since television shows have episodes. It even has a built-in screen saver that uses the fan art that it's downloaded.

You'll have to check out some of the sample screen shots so you can see how it nice it really looks. They have shots of the home screen, listing 24 and Soprano episodes, music albums, weather, browsing movies using the artwork, etc...
http://www.flickr.com/photos/29133065@N05/

HTPC Hardware

The actual HTPC is very simple. I just have a motherboard with CPU,F/HS,Memory and a hard drive with Vista installed. I didn't bother with a DVD/Bluray as I have no need for one. If I do, I can just plug a USB DVD or just share own over the network. The Motherboard has onboard NVidia with an HDMI output that goes into my AV receiver.
Image
Image

Media

As for getting media onto the unRAID server, well there are various options. One that I can recommend is using AnyDVD + CloneDVD to deal with getting the DVD files on disk as either an ISO or VOB. When you rip them you do not want to compress them any further. You want to rip them 100%. Then you have a couple options. You can either keep the mpeg2 versions just as they are and copy them over to the unRAID server or you can use something like Handbrake which can create mpeg4 versions which take up less than half the space of the original DVD format. It's basically a space vs. time issue. Ripping the DVD only takes like 4-5 minutes, but converting it to mpeg4 takes another 4-5 hours. While Handbrake can convert straight from the DVD, because of the amount of time it takes its recommended to rip it first, otherwise you're putting a lot of strain on the DVD drive for 4-5 hours. I've tested various conversion software and Handbrake is by far the easiest to use and is well documented. It's also free. One thing you can do is rip several DVDs and then you can queue up to conversion for each one. So for example, rip 4-5 DVDs and you have 24 hours worth of conversion that you can schedule. I have a seperate Windows server where I can do this from. Otherwise, just use your desktop and convert while you're sleeping.
Last edited by valryte on June 28, 2009, 4:19 am, edited 4 times in total.
User avatar
valryte
Almost 1337
Almost 1337
Posts: 679
Joined: August 28, 2002, 12:58 am

Re: HTPC Network

Post by valryte »

The beauty of using unRAID is that you can use spare hardware that you have lying around. It doesn't take a whole lot as long as it meets the minimum requirements, which is mostly being able to boot from a USB flash drive and the Sata controller chipset.

unRAID Server

Server Case $59.99
http://www.newegg.com/Product/Product.a ... 6811119152
I picked this one for it's price, perforated bay covers in the front, 9x 5.25 bays which lets me use 3x 4 drives cages for a total of 12 drives.

4-in-3 Drive Cages $21.99
http://www.newegg.com/Product/Product.a ... 6817993002
It has a 120mm fan built on. The front bezels can be removed so that you can keep the 5.25 drive covers that the server case has. The server case actually has 1 cage, so technically you only need 2 of these. Also these cages have the fans riveted on, so if you ever needed to replace the fans you'd need to use a Dremel to remove the rivets, but for 22 bucks they are fine. Alternatives can run about $100.

PSU $80-90
I think its like a 600W Thermaltake.

Motherboard
I used a Gigabyte ultra durable motherboard that I had as a spare. They are rock solid. Was probably around $120, but I can't recall exactly. It has like 6-8 sata ports which is great.

CPU
I used a Dual core 2.6 which I had spare from upgrading my other computers.

Memory
2 Gigs that I had spare from previous upgrades.

Hard Drives
I threw in 2x 500 and 2x 250 Sata drives that I had lying around from previous upgrades. They aren't that fast, but was good enough to start with. I can eventually replace them with bigger/faster drives easily. Since I first built it, I've added some 1TB Western Digital Black Caviar drives as well as 1TB Seagate Barracudas. It's just a cost issue. Both drives work nicely. I'll be moving on to 1.5TB Seagates from now on though which will require me to swap the current 1TB parity drive with the new 1.5TB drive so in the future I can use 1.5TB data drives. Just waiting for the 1.5 TB drives to drop to 119 again.

SATA Controllers $35
http://www.newegg.com/Product/Product.a ... 6815124027
I got 2 of these.

HTPC (Vista)

Case $55
http://www.newegg.com/Product/Product.a ... 6811121027
It's cheap, small, and black. Other HTPC cases can run 200-300.

Motherboard $130
http://www.newegg.com/Product/Product.a ... 6813128363
Its Gigabyte with onboard GeForce 9400 and HDMI output. That has more than enough horse power to handle your video streaming needs.

CPU $120
http://www.newegg.com/Product/Product.a ... 6819115206
Intel Core 2 Duo 2.8Ghz

Memory
I used some left over memory from previous upgrades.

IR Receiver $23
http://www.newegg.com/Product/Product.a ... 6880121001
Its actually a Media Center Remote that comes with an USB IR receiver. I don't use the actual remote as I have a Logitech Harmony, but you need it's IR receiver to get the commands into the HTPC from the remote.

Remote $190
http://www.logitech.com/index.cfm/remot ... 8&cl=US,EN
I've used the large touchscreen remotes (Prontos, Logitech, etc...) but in the end this has been my favorite. No matter what, I still like real buttons and something I can control with 1 hand.


There's one more piece of software that is required to make all the magic work. Its called Event Ghost. Basically this piece of software, once configured will be in charge of relaying commands from the IR receiver to XBMC. You see, XBMC doesn't have any IR support. Only keyboard and a port it listens on for commands. Event Ghost is able to receive commands from the IR Remote Receiver that you get with the remote control and then send the appropriate commands to XBMC using the port that it listens on. It sounds a lot more complicated than it actually is. If you happen to have something like a Logitech remote, all you do is configure a new device as an XBox 360. Then Event Ghost is configured to relay the XBox 360 commands to XBMC and pretty much everything will work. After that it's up to you to configure additional events in Event Ghost to customize it to your liking. The things you can do with it are pretty powerful. For example I have mine setup so that I can press a button and it will launch this XBMC updater that will pull the nightly builds to keep my XBMC up to date. I also have Event Ghost triggering library refreshes once a day so it can pull down any info, art from new movies/shows that I've add. Otherwise you have to trigger this manually in XBMC.


Like I said, it took a while to get all the pieces in place, but now it works perfectly. I simply click a button on my remote to switch my home theater to the HTPC and I have access to all my movies and shows without having to deal with any physical media.
When the world is mine, your death shall be quick and painless.
User avatar
Drolgin Steingrinder
Way too much time!
Way too much time!
Posts: 3510
Joined: July 3, 2002, 5:28 pm
Gender: Male
PSN ID: Drolgin
Location: Århus, Denmark

Re: HTPC Network

Post by Drolgin Steingrinder »

I will get something like this at some point - when I'm living somewhere with room for more than a laptop.
IT'S HARD TO PUT YOUR FINGER ON IT; SOMETHING IS WRONG
I'M LIKE THE UNCLE WHO HUGGED YOU A LITTLE TOO LONG
User avatar
Sylvus
Super Poster!
Super Poster!
Posts: 7033
Joined: July 10, 2002, 11:10 am
Gender: Male
XBL Gamertag: mp72
Location: A², MI
Contact:

Re: HTPC Network

Post by Sylvus »

America has vast tracts of land...
"It's like these guys take pride in being ignorant." - Barack Obama

Go Blue!
Tombfyre
No Stars!
Posts: 13
Joined: May 17, 2005, 9:49 am

Re: HTPC Network

Post by Tombfyre »

Nice writeup, and it came at the perfect time for me. I've been assembling parts for an upgrade to my fileserver (really just an old PC with some largish hard drives that I use to store media files) and also to build an HTPC. I've been researching for the last few weeks, and there's a lot of info out there, but quite a bit that I've found is outdated. UnRAID sound freaking awesome, I wasn't looking forward to building an array of 1TB or 1.5TB drives.

I had a few questions if you have a chance...

1.) Does the Motherboard you use send audio through the HDMI, or do you need to use an optical/coax cable for audio?
2.) I'm planning on upgrading my version of anydvd to the anydvdHD and start ripping ISO's of Bluray movies - do you know if 7.1 audio is supported when running through the HTPC? It's not really a big deal to me...I have a new receiver that supports 7.1, but I still only have 5 speakers. Just curious for the future when I stop being cheap and buy a few more speakers.

I've been converting movies into AVI for awhile now, but with hard drives as cheap as they are now, I just can't justify the time spent converting, so I'm just keeping ISO images now.

Thanks again for posting this info, very handy.
User avatar
valryte
Almost 1337
Almost 1337
Posts: 679
Joined: August 28, 2002, 12:58 am

Re: HTPC Network

Post by valryte »

1.) Does the Motherboard you use send audio through the HDMI, or do you need to use an optical/coax cable for audio?
Yes, the motherboard I'm using is sending audio and video via HDMI, but also has optical which may be needed in some cases by XBMC, though I haven't done much testing with this. I'll see when I can rip one of my BDs that has a TrueHD audio track and test it out.
2.) I'm planning on upgrading my version of anydvd to the anydvdHD and start ripping ISO's of Bluray movies - do you know if 7.1 audio is supported when running through the HTPC? It's not really a big deal to me...I have a new receiver that supports 7.1, but I still only have 5 speakers. Just curious for the future when I stop being cheap and buy a few more speakers.
Yes, XBMC supports 7.1. It pretty much supports everything.

http://xbmc.org/about/features/
Supported audio codecs:

* CDDA (Audio-CD) playback
* WAV/WAVE (WAVEform) and PCM audio format
* AIFF (Audio Interchange File Format) audio
* MPEG layer I, II, and III (inluding MP2 and MP3) audio #5
* OGG (Ogg Vorbis audio codec)
* WMA - Windows Media Audio v1 and v2 (WMA1 / WMA2 / DivX Audio v1/v2) #5
* WMA - Windows Media Audio 9 (WMA9) #5
* WMA Pro Audio Codec (Windows Media Audio 9 Professional)#5
* RealNetworks RealAudio codecs: 1.0 (14.4), 2.0 (28.8 ), SIPRO, COOK, COOKER, DNET and ATRAC3
* AC3 2.0 or 5.1 and Dolby Digital EX 6.1 or 7.1 audio in video (AC3 digital cable S/PDIF pass-through)
* Dolby Digital AC3 and AC3-WAV/AC3-CDDA 2.0 and 5.1 audio in video software decoded to stereo analog-out
* Dolby Digital Plus (a.k.a. E-AC3), and Dolby TrueHD 7.1 audio software decoder
* Dolby Digital Plus (a.k.a. E-AC3), and Dolby TrueHD 7.1 audio in Blu-ray rips via digital cable S/PDIF pass-through

* DTS (Digital Theater System) 5.1 and DTS-ES 6.1 audio in DVD-Video (DTS digital cable S/PDIF pass-through)
* DTS (DTS and DTS-WAV/DTS-CDDA) audio in DVD-Video (software decoded)
* AAC (Advanced Audio Coding) profiles: Main, LC, HE, LTP, LD, ER, and aacPlus v1/v2 (AAC+ SBR/PS) audio #5
* M4A and MP4 (MPEG-4 Audio) (including Nero Digital MP4) #5
* PureVoice (QCELP) audio decoder
* AVS (Audio Video Standard) audio codec
* FLAC (Free Lossless Audio Codec) audio
* WavPack lossless audio
* MPC (Musepack, a.k.a. Mpeg+) lossless audio #6
* APE (Monkey’s Audio) lossless audio
* SHN (Shorten) lossless audio
* ALAC (Apple Lossless Audio Codec) lossless audio #6
* MLP (Meridian Lossless Packing) / Packed PCM (PPCM) audio decoder
* AMV audio decoder
* Sonic audio decoder
* AIFF/AIFF-C audio dcoder
* Macromedia ADPCM decoder
* Creative ADPCM audio decoder (16 bits as well as 8 bits schemes)
* Nellymoser ASAO decoder
* True Audio (TTA) decoder
* TrueSpeech audio decoder
* Intel Music decoder
* QDM2 audio decoder
* Delphine Software .cin audio decoder
* 8SVX audio decoder
* MIDI music using Timidity
* Tracker Mod’s audio, see list below:
o Adlib (AdLib and Sound Blaster OPL2/OPL3 and Dual OPL2/OPL3) FM audio
o SID (Commodore 64 tunes) audio
o YM (ATARI ST) audio
o NSF (Nintendo NES Sound Format) audio
o SPC (SPC700) audio
o GYM (SEGA Genesis) audio
o ADX/AST/ADP/DSP/YMF/HPS CRI MiddleWare and Gamecube ADPCM) audio
o MOD/AMF/669/DMF/DSM/FAR/GDM/IMF/IT/M15/MED/OKT/S3M/STM/SFX/ULT/UNI/XM
* vgmstream playback of 51 more streamed audio formats used in video games:
o aax, asd, asr, ass, bgw, bh2pcm, capdsp, ccc, dcs, de2, emff, fag, gbts, gca, gsb, idsp, idvi, isd, joe, kraw, mihb, msvp, mwv, omu, p2bt, pdt, rnd, rwar, rwav, sap, seg, smp, spd, spsd, spw, ss7, ssm, thp, vgs, vs, waa, wac, wad, wam, xa2, xmu, xsf, xvas, ydsp, ymf, zwdsp
I've been converting movies into AVI for awhile now, but with hard drives as cheap as they are now, I just can't justify the time spent converting, so I'm just keeping ISO images now.
Yeah I'm probably just going to rip the DVDs and forget converting them as well. 2-3 hours vs 5 minutes is realistically too much time. If I ever need space I can always go back and convert the ripped DVDs if I really wanted to. Bare in mind, all my DVDs will take up at least 2TBs in its native format hehe.
When the world is mine, your death shall be quick and painless.
Tombfyre
No Stars!
Posts: 13
Joined: May 17, 2005, 9:49 am

Re: HTPC Network

Post by Tombfyre »

Nice, thanks for the reply. Think I'm all set, just need to buck up and spend some money, hehe.
all my DVDs will take up at least 2TBs in its native format
Yeah, that's a bit brutal...I haven't done the math on my entire collection yet. Urgh.
User avatar
Aabidano
Way too much time!
Way too much time!
Posts: 4861
Joined: July 19, 2002, 2:23 pm
Gender: Male
Location: Florida

Re: HTPC Network

Post by Aabidano »

Sylvus wrote:America has huge tracts of land...
But he just wants to.... Sing!
"Life is what happens while you're making plans for later."
User avatar
valryte
Almost 1337
Almost 1337
Posts: 679
Joined: August 28, 2002, 12:58 am

Re: HTPC Network

Post by valryte »

I modified the post slightly to include some screenshots of XBMC so that it sticks out a bit in the post since from the sounds of the Boxee post, XBMC seems to be completely unknown even though I put this huge post up. I didn't put a post just on XBMC because frankly as software by itself it's not really all that useful to someone unless they know about everything else that's needed.
When the world is mine, your death shall be quick and painless.
Tombfyre
No Stars!
Posts: 13
Joined: May 17, 2005, 9:49 am

Re: HTPC Network

Post by Tombfyre »

Finally ordered parts for the HTPC today, using your recommendations. I'll post how it worked out in a few weeks. Next on the list is to upgrade my PC, and use the leftover parts to build a new fileserver w/ an unRAID configuration.
Tombfyre
No Stars!
Posts: 13
Joined: May 17, 2005, 9:49 am

Re: HTPC Network

Post by Tombfyre »

Received the parts on Monday, and built the PC last night. So far so good. XBMC is working beautifully for playing my AVI and ISO files. It won't play Blu-Ray ISO's, but I'm able to mount those with Virtual CloneDrive, and then using Cyberlink PowerDVD Ultra 9 to play the movie.

The configuration of Event Ghost is giving me a bit of a headache, think I'll mess with it tomorrow instead.
Post Reply