Personal ReplayGuide Build 200 Beta Released

[Lee Thompson]

Changes from build 199:


Fixed an issue that was causing blank "referer" errors in Apache 2's error.log.
Added two new flags in the prg.conf under [datadirect2sql] for controlling if the new data appears or not. The default for both is true/enabled. (syndicate/production episode number and original airdate/first aired date are the data fields.)
Fixed an issue where the script would change to the user's home directory. This is fixed.
Fixed a bug I introduced during a code cleanup of datadirect_client and broke it so it only gave you a few days. Fixed now. *Blush*.
Fixed a problem where the Replay guidesnapshot was not updating after scheduling a show even if the option was enabled.
Added support for several new DataDirect fields (they will appear in the PRG description), syndicated ep # and original airdate. This new data should begin appearing on or about April 12th 2004.
Improved the providerid detection.
Fixed a problem with handling the lineup and lineupdevice fields.


Barring any major bugs, this will be the last build for awhile as I will be adding some more features. (see the future.txt file for details).

[JohhnyReplay]

Got it installed...fairly painless upgrade from 198. I did have to manually edit the beginning of replayguide.pl to delete the windows perl call and use the linux line instead, but that was about the only thing I had to change in the pl files (which is a lot better than 198).

One question though. Now I have two datadirect lineups included... but there isn;t a menu to show one or the other, they just get mixed together in the channel lineup. It that the expected behaviour? If it is, no prob. Just checking...

Thanks, Lee, for the great tool!

[Lee Thompson]

Multiple DD lineups will be combined in the listings. (They are combined in the XML from DD as well.)

Each lineup will have a multiplier of 1000. (The multiplier is adjustable).

In the cases of duplicated channels (say you have two SCIFI west coast feeds), the lowest channel # will win.

None of this should affect scheduling recordings or seeing what's scheduled.

[TheDreamer]

Good, so this should be the version to finally upgrade my build 190 setup to....

Kind of pain upgrading, because my setup is so convoluted.

The Dreamer

[JohhnyReplay]

Hmm... so I just noticed that replayguide is connecting to the replays, but it isn;t getting the entire list of upcoming shows. It's kind of odd, because I thought it was working fine yesterday.

[Lee Thompson]

The "rg_scheduler.pl" module (which uses replayschedule.exe) doesn't refresh every n minutes like it used to, it runs automatically at the end of each listings update. You can, of course, force it to rebuild the todo list etc by selecting "Manual Refresh" on the RTV tool.

The "rg_guide.pl" module still refreshes every n minutes (if set to do so).

You can also check the log file and see if any errors are being reported...

[horseflesh]

I am also upgrading from build 190.

First, big kudos on this new build. The documentation is much better too! I know it's no fun to do but the effort will be much appreciated by new users. The inclusion of SQLite is slick too though I will stick with MySQL just because I already have it running for other stuff.

Now the problem I am having...

I am getting this in my Apache log when I try to run replayguide.pl:

Undefined subroutine &main::parseModuleData called at /home/www/data/prg/replayguide.pl line 155.

Edit:
Took a closer look... noticed that parseModuleData IS in one of the rg_ files. Strangely, "." is in my @INC yet leaving rg_common.pl (etc) alongside the rest of the scripts was not working. I copied them into one of the other dirs in my @INC list (thanks "perl -V") and now the scripts are running. Just gotta debug the db connection now. :)

[horseflesh]

Everything is cool now. I love the to-do list! Great release.

The only problem I am having is with the channel icons. The script runs but it is apparently not able to grab anything.

I tried specifying and leaving out my ZIP and provider code in prg.conf but either way I get the errors seen below.

I have triple-checked the existence and permissions on the channel icon cache directory, it all looks good. Perhaps the site is flaky tonight?

********************************************************
Personal ReplayGuide:Get Channel Icons v1.0 (Build 23) ./getchannelicons.pl
Running as ./getchannelicons.pl with PID 44880
Remote Address: 127.0.0.1
Console Output: Enabled
rg_common v1.1 build 223 (Common Function Library) loaded.
rg_info v1.2 build 103 (Database Initialization Library) loaded.
rg_database v1.1 build 228 (Database Function Library) loaded.
rg_config v1.0 build 26 (Configuration Function Library) loaded.
getchannelicons v1.0 build 23 (Get Channel Icons) loaded.
Job started at 2004-04-05 02:54:54
Database Connection Established to DBI:mysql:tvlistings using handle DBI::db=HASH(0x83bf698)
Lineup: 98034 DISH Seattle
getProviderID returned 0
Using default providerid (0)
10626: Could not find an icon
10518: Could not find an icon

etc, etc... No icons are retrieved and saved.

[horseflesh]

Oh, a side note on ReplaySchedule --

I run FreeBSD and I am able to use the Mac OS X Makefile -- no great surprise since there is a lot of BSD under the hood of OS X. Maybe this Makefile could be renamed ".bsd-osx" or something like that to reflect its split personality? Or maybe just name it ".bsd" and note that it is for OS X, FreeBSD in COMPILE.txt.

(I don't have OpenBSD or NetBSD but it may work on them, too.)

I dunno, it just seemed worth mentioning.

[JohhnyReplay]

Thanks for the ideas on how to solve my problem, Lee. I am forcing a manual update, but to no avail. It does seem to be capturing 3 shows from the replays, but not the rest. Nothing is showing up in the log.

[moyekj]

Originally posted by JohhnyReplay
Thanks for the ideas on how to solve my problem, Lee. I am forcing a manual update, but to no avail. It does seem to be capturing 3 shows from the replays, but not the rest. Nothing is showing up in the log. I will be releasing a new version of replaySchedule (116.30) in a couple of hours that fixes a couple of problems - one related to at-or-around matches and another related to missing matches for the latest added channel to the RTV (when using replaySchedule without temporary guide dump files which is now the default mode). I don't know if your problem is related to these fixes or not (doesn't sound like it), but I will post back here when it is released so you can try it.

[Lee Thompson]

JohhnyReplay,

I'll take another look at getchannelicons.pl - basically it goes to the www.zap2it.com configuration page to determine the provider id and then it goes to a listing page with that information to scrape icons.

You can also force the zipcode and providerid in the prg.conf under the [geticons] section. In your case it would be:


[geticons]
zipcode=98034
providerid=128761


That should get it working in the meantime.

[moyekj]

I've released a new version of replaySchedule (116.30) with a couple of bug fixes. I also added a Makefile.bsd to the distribution and a note on the web page indicating it compiles under that platform (thanks horseflesh). It is highly recommended anyone using replaySchedule to update to this new version.

[JohhnyReplay]

Teh new replaySchedule worked great! Thanks!

[horseflesh]

getchannelicons is working for me now -- it must have been a problem with the site late last night.

(It would be nice if the script would echo the URL it is trying in the error output -- that way the user can check the link in their browser to see if there is a connectivity problem.)


Also the new BSD stuff in replaySchedule works great, thanks moyekj!

[Lee Thompson]

Originally posted by horseflesh
Everything is cool now. I love the to-do list! Great release.

The only problem I am having is with the channel icons. The script runs but it is apparently not able to grab anything.

I tried specifying and leaving out my ZIP and provider code in prg.conf but either way I get the errors seen below.

I have triple-checked the existence and permissions on the channel icon cache directory, it all looks good. Perhaps the site is flaky tonight?

********************************************************
Personal ReplayGuide:Get Channel Icons v1.0 (Build 23) ./getchannelicons.pl
Running as ./getchannelicons.pl with PID 44880
Remote Address: 127.0.0.1
Console Output: Enabled
rg_common v1.1 build 223 (Common Function Library) loaded.
rg_info v1.2 build 103 (Database Initialization Library) loaded.
rg_database v1.1 build 228 (Database Function Library) loaded.
rg_config v1.0 build 26 (Configuration Function Library) loaded.
getchannelicons v1.0 build 23 (Get Channel Icons) loaded.
Job started at 2004-04-05 02:54:54
Database Connection Established to DBI:mysql:tvlistings using handle DBI::db=HASH(0x83bf698)
Lineup: 98034 DISH Seattle
getProviderID returned 0
Using default providerid (0)
10626: Could not find an icon
10518: Could not find an icon

etc, etc... No icons are retrieved and saved.

Icons are only saved locally if you're using XMLTV at this time. If you're using DataDirect they are http references.

I was unable to reproduce this, perhaps it has something to do with your network?


004-04-05 12:25:52 getchannelicons::Personal ReplayGuide:Get Channel Icons v1.0 (Build 23) getchannelicons.pl
2004-04-05 12:25:52 getchannelicons::Running as getchannelicons.pl with PID 34312
2004-04-05 12:25:52 getchannelicons::Remote Address: 127.0.0.1
2004-04-05 12:25:52 getchannelicons::Console Output: Enabled
2004-04-05 12:25:52 getchannelicons::rg_config v1.0 build 26 (Configuration Function Library) loaded.
2004-04-05 12:25:52 getchannelicons::getchannelicons v1.0 build 23 (Get Channel Icons) loaded.
2004-04-05 12:25:52 getchannelicons::rg_info v1.2 build 103 (Database Initialization Library) loaded.
2004-04-05 12:25:52 getchannelicons::rg_database v1.1 build 228 (Database Function Library) loaded.
2004-04-05 12:25:52 getchannelicons::rg_common v1.1 build 224 (Common Function Library) loaded.
2004-04-05 12:25:52 getchannelicons::Job started at 2004-04-05 12:25:52
2004-04-05 12:25:52 getchannelicons::Database Connection Established to DBI:ODBC:test_prg using handle DBI::db=HASH(0x24b087c)
2004-04-05 12:25:53 getchannelicons::Lineup: 98034 DISH Seattle
2004-04-05 12:25:55 getchannelicons::getProviderID returned 128761
2004-04-05 12:26:16 getchannelicons::24247: Could not find an icon
2004-04-05 12:26:16 getchannelicons::24237: Could not find an icon
2004-04-05 12:26:16 getchannelicons::24238: Could not find an icon
2004-04-05 12:26:16 getchannelicons::24239: Could not find an icon
2004-04-05 12:26:16 getchannelicons::24240: Could not find an icon
2004-04-05 12:26:16 getchannelicons::24241: Could not find an icon
2004-04-05 12:26:16 getchannelicons::24244: Could not find an icon
2004-04-05 12:26:16 getchannelicons::24949: Could not find an icon
2004-04-05 12:26:16 getchannelicons::24950: Could not find an icon
2004-04-05 12:26:16 getchannelicons::27891: Could not find an icon
2004-04-05 12:26:16 getchannelicons::24262: Could not find an icon
2004-04-05 12:26:16 getchannelicons::22919: Could not find an icon
2004-04-05 12:26:16 getchannelicons::22920: Could not find an icon
2004-04-05 12:26:16 getchannelicons::22924: Could not find an icon
2004-04-05 12:26:16 getchannelicons::22925: Could not find an icon
2004-04-05 12:26:16 getchannelicons::22926: Could not find an icon
2004-04-05 12:26:16 getchannelicons::22927: Could not find an icon
2004-04-05 12:26:16 getchannelicons::22928: Could not find an icon
2004-04-05 12:26:16 getchannelicons::22929: Could not find an icon
2004-04-05 12:26:16 getchannelicons::34781: Could not find an icon
2004-04-05 12:26:16 getchannelicons::26456: Could not find an icon
2004-04-05 12:26:16 getchannelicons::34470: Could not find an icon
2004-04-05 12:26:16 getchannelicons::20427: Could not find an icon
2004-04-05 12:26:16 getchannelicons::24231: Could not find an icon
2004-04-05 12:26:16 getchannelicons::18525: Could not find an icon
2004-04-05 12:26:16 getchannelicons::16315: Could not find an icon
2004-04-05 12:26:16 getchannelicons::14075: Updated with http://tvlistings2.zap2it.com/tms_network_logos/playboy.gif
2004-04-05 12:26:16 getchannelicons::16788: Could not find an icon



The URL it's trying to get to for the providerid is:


http://tvlistings2.zap2it.com/zipcode.asp?partner_id=national&zipcode=ZIPCODE



For the icon scraping it is:


http://tvlistings2.zap2it.com/listings_redirect.asp?partner_id=national&id=form1&name=form1

[horseflesh]

I was unable to reproduce this, perhaps it has something to do with your network?

I think there was a problem with Zap2It last night, everything is OK now.

[Lee Thompson]

Originally posted by horseflesh
I think there was a problem with Zap2It last night, everything is OK now.

Ah, works for me :)

[horseflesh]

After installing the new replaySchedule I am having a problem with PRG/replaySchedule integration. Previously this was working great -- all I did to break it was place the new replaySchedule executable in my PRG directory.

replaySchedule itself seems to be working--it compiled file and I can retrieve data from my Replay from the command line, eg:

$ ./replaySchedule --ip 192.168.1.42 --debug

PRG shows my "Living Room" replay in the pulldown menu. It also says, "Refreshing Living Room ... Complete" at the top of the page. But if I choose any action from the menu (Refresh, To-Do, etc) the web page says, Did not find any matches for "Living Room".

If I try to schedule a show, the web page says "No ReplayTV Units Defined." But it IS in the menu...

I re-ran the config script but it did not help.

The PRG log file (attached) has a lot more info but most of it is Greek to me.

Any ideas?

Thanks!

[moyekj]

Originally posted by horseflesh
replaySchedule itself seems to be working--it compiled file and I can retrieve data from my Replay from the command line, eg:

$ ./replaySchedule --ip 192.168.1.42 --debug
Make sure that it is indeed working fine via command line. For example, for use with PRG you will need to specify --dd flag to tell it the tv listings are in DataDirect format. So the command line run will look more something like:

./replaySchedule --ip 192.168.1.42 --schedule na.xml --dd
where na.xml is the DataDirect listings file in this example.

Then check the generated sched.html with a browser to see if the resulting to do listings look reasonable. If it looks OK, great then your troubles are elsewhere, if not OK then run again in debug mode and generating guide dump files as follows:

./replaySchedule --ip 192.168.1.42 --asciidump asc --bindump bin --schedule na.xml --dd --debug >debug.out

Then zip up the following files and send to me (here or to moyekj@yahoo.com):
asc.192.168.1.42
bin.192.168.1.42
na.xml
sched.html
debug.out

[Lee Thompson]

Originally posted by horseflesh
After installing the new replaySchedule I am having a problem with PRG/replaySchedule integration. Previously this was working great -- all I did to break it was place the new replaySchedule executable in my PRG directory.

I want to ask a few simple questions just to help narrow this down...

1. Are you indeed using DataDirect? (NOTE: If you are using the XMLTV tv_grab_na_dd grabber , that won't work wtih PRG)

2. Is the datadirect XML file called "na.xml" and in the same directory as replayschedule?

3. The fact that it says there aren't ReplayTVs defined when you try to schedule a show indicates to me that replayschedule is not able to download a guidesnapshot from the ReplayTV or is encountering some kind of error (definately do what moyekj suggested...)

[horseflesh]

1. Yes, I am using the native DD support in PRG. My updatetvdata.pl seems to work fine, and I can browse the program guide via http.

2. Yep, na.xml is stored in the same dir as replaySchedule (and all the pl and conf files for that matter, save those .pl's that need to be in @INC.)

I am re-running updatetvdata in case I fubared a data file somehow and then I am going to try moyekj's steps...

Edit:

After running updatetvdata.pl again all the scheduler functions are working. I think I know what the problem was: I did not kill my nightly tv_grab_na job right away, so I did not notice that na.xml (dd format, built during my PRG build 200 install) got clobbered by the automated non-dd file download just after I got everything working!

I'd suggest log spew like "na.xml exists but is not in DataDirect format" for other lugheads like me.

'course now the channel icons are not working again--I'll have to check those URLs. No biggie.

Thanks guys!

[ArtieMcD]

Just wanted to post to say we upgraded to 200 and verified it is working great in our environment. All issues we reported from 197 to 199 are no longer issues. The only config step we had to take was to remove the c:\Perl line from the replayguide.pl file.

[Lee Thompson]

Artie,

Thanks! :) Yeah sorry about the C:\Perl thing -- but as far as bugs go, that's an easy one :)

[inkspoof]

Props to you guys for this update. It really rocks!

[zabolots]

Finally updated my install from 180 to 200. Very nice indeed.

One small problem though. If I grab more than a few days of data I get an "Out of memory!" error when updating via the datadirect_update.bat file.


2004-04-10 11:46:06 ********************************************************
2004-04-10 11:46:06 Personal ReplayGuide:DataDirect Client v1.0 (Build 24)
2004-04-10 11:46:06 Running as datadirect_client.pl with PID 468
2004-04-10 11:46:06 Remote Address: 127.0.0.1
2004-04-10 11:46:06 Console Output: Enabled
2004-04-10 11:46:06 rg_config v1.0 build 26 (Configuration Function Library) loaded.
2004-04-10 11:46:06 rg_common v1.1 build 223 (Common Function Library) loaded.
2004-04-10 11:46:06 Job started at 2004-04-10 11:46:06
2004-04-10 11:46:06 Requesting up to 7 days of data from DataDirect
2004-04-10 11:46:06 Building SOAP Object for http://docs.tms.tribune.com/tech/tmsdatadirect/zap2it/xtvd.wsdl
2004-04-10 11:46:07 SOAP Object Completed
2004-04-10 11:46:07 Starting Data Download
2004-04-10 11:46:59 Data Download Complete
2004-04-10 11:46:59 Converting to UTF8
2004-04-10 11:47:39 Conversion Complete
2004-04-10 11:47:39 Checking for Errors
2004-04-10 11:48:20 Check Complete
2004-04-10 11:48:20 Looking for Data Block


The "Out of memory!" error appears on the screen after the "Looking for Data Block" but does not get written to the log file.

Any ideas? The system has plenty of VM space available when this occurs as I increased my pagefile size and do not get any "Windows is getting low on virtual memory" notifications.

Thanks...Scott

[Lee Thompson]

Scott,

Is "Out of Memory" a Windows popup message? What OS are you running and how much physical RAM is in the machine?

Perl does use a *lot* of RAM for this (256MB for 7 days of listings is not unheard of with VM memory about three times that.) This is just the nature of this since it's all memory resident.

[zabolots]

Originally posted by Lee Thompson
Scott,

Is "Out of Memory" a Windows popup message? What OS are you running and how much physical RAM is in the machine?

Perl does use a *lot* of RAM for this (256MB for 7 days of listings is not unheard of with VM memory about three times that.) This is just the nature of this since it's all memory resident.

No, the "Out of memory!" is not a Windows popup message. It appears in the console windows with all of the PRG logging statements. I'm pretty sure it's a Perl error.

The machine is running Win2k and has 64MB RAM and 128MB of virtual memory (hey, it's an old box that I had lying around!). The first time I ran the datadirect_update.bat file I had only 64MB of virtual memory and got a Windows popup message ("Your system is running low on virtual memory") immediately after the "Out of memory!" Perl error. Once I bumpted the virtual memory up to 128MB I no longer got the windows popup message but still got the Perl error.

I'll try bumping up the virtual memory some more and see what happens.

Scott

I increased my virtual memory size to 384 (found out my installed RAM is actually 128MB, not 64MB) and tweaked my DataDirect channel lineup to get rid of a few channels that I'm not really interested in and now I can download 12 days worth of data with no problem.

[TheDreamer]

Well, I finally did it....I upgraded my build 190 setup to build 200.

It was tricky because my setup is kind of weird. And, I probably made it harder on myself by upgrading perl on my box (5.6.1 -> 5.8.3)...but I had been having xmltv build issues with the install I had (namely -- perl Makefile.PL was failing....so I hadn't upgraded in a while). That, and I have parts of PRG in my home directory...to run the update and such as the local user...and the webserver elsewhere as root (suid to nobody)....because it needs to be privileged to be on ports under 1024.

I kept my tweaked update script...so I continued to use my fixlogos program. Though was a bit harder to get xmltv2sql.pl to run all the way through, because it does more....

Then the last hurdle...was the first line of replayguide.pl....and then pretty much everything works (except manual recording, but I've never used that...so I'll leave that for some other time.)

The Dreamer.

[ndrake]

Hi,

I added some simple keyboard navigation to PRG200. Basically, you can hit "f" and "p" to move forward/backward in time (just like you pressed the >>> or <<< buttons). When the page reloads, the browser will also scroll to where you were at. This saves you from scrolling to the top of the page to press the >>>/<<< buttons and then scrolling back down to wherever you where in the listing.

I tested it on the following browsers:

Firefox 0.8 (WinXP)
IE 6 (WinXP)
Safari 1.2.1 (Mac OS X)
IE 5.2 (Mac OS X)

I had to change rg_common.pl and replayguide.pl. See attached zip file for diffs and updated files.

Let me know if you have any trouble with it.

Nate

[TheDreamer]

Well, today...I decided to make the leap...and try to get datadirect to work.

First problem I have is now 6 hours won't fit into my screen width....is it just because there's so much more information now or did something else change because it knows it is datadirect now?

Hmmm, or is because there are no more channel icons....so the boxes are more packed than they used to be. I couldn't get getchannelicons to work...getProviderID always comes back as 0....and even when I hardwired the providerID...it still couldn't find the icons.

Anyways...I thought I would change the showepisodenumber and showfirstaireddata options off....but it still put the info in. Found out why...the options are in the wrong place in prg.conf. They are documented and set in [datadirect], but the need to go in the [datadirect2sql] section.

The Dreamer

[TheDreamer]

Well getchannelicons.pl seems to be having some kind of cookie issue.

When I added options like "file =>, autosave => 1, ignore_discard => 1" and ran it twice...it would succeed in getting the provider ID.

But, it still can't get icons....though it still looks like a cookie issue, because peeking at $res->content() in the channel icon section, shows it is reprompting for zipcode....(even though the zipcode is in the URL).

The Dreamer

[Lee Thompson]

Dreamer,



Anyways...I thought I would change the showepisodenumber and showfirstaireddata options off....but it still put the info in. Found out why...the options are in the wrong place in prg.conf. They are documented and set in [datadirect], but the need to go in the [datadirect2sql] section.


I've fixed the docs.

Not sure why getchannelicons.pl isn't working for you, it works here on both my current dev version and the distributed build 200. I don't think it has anything to do with cookies to be honest but I'm no expert with scraping.

(I have been working on PRG btw, and thanks to some research I completed this week I think you guys are really gonna like it... )

[homer stanford]

Are local channel icons usable in version 200? I can not get it to find my local stored icons.

I am getting 2 and 3 recording, recurring icons for shows I have set to record;
------------------------------
"The Big Picture"
(Sitcom) Series. Holly wonders if she made the right choice to end her relationship with Henry; Val meets Rick's fiance, who later tells him not to be friends with Val. (Ep #219 First Aired: 2004-04-16) 30 minutes. TV-PG. CC Stereo.
( - Recurring)( - Recurring)(Living Room - Recurring)
Grounded for Life
"You're So Vain"
(Sitcom) Series. Claudia's father (Stephen Root) comes to visit; Sean can finally pay off his debt to Tony. (Ep #415 First Aired: 2004-04-16) 30 minutes. TV-PG. CC Stereo.
( - Recurring)( - Recurring)(Living Room - Recurring)
------------------------------


I only have the recording icons defined in one place
------------------------------
wwwdir=/
scriptdir=/replay-bin
imagedir=http://127.0.0.1/~user/images/replay
scriptname=replayguide.pl
schedulename=schedule.pl
usingapache=1
------------------------------

channelicondir is defined in two places in prg.conf, in [geticons] and [replayguide]

[Lee Thompson]

homer,

Local channel icons aren't quite supported yet which is why that's not working as you'd expect. I'll try to get that in the next release, if it doesn't make it in that one it'll be in soon after.

[TheDreamer]

The [geticons] section should probably be named [getchannelicons]

I also need to have local icons...because telling the browser to allow non-SSL on an SSL page gets old fast.

Meanwhile, I solved my formatting problem....6 hours does fit on a screen again.....the problem is datadirect provides much <class> types....and the important was joining them with '/'...which made for a really long word pushed boxes out... I changed it to ', '...and that got it looking good again.

I only really need to see 5 hours (to check my evening schedule for any conflicts that might have creeped in)...but using '<<' and '>>' it doesn't go into 24 very evenly.

defaultslot=60 doesn't seem to work.....

The Dreamer.

[horseflesh]

I was having a problem getting the channel icons as well. Then it went away. Then it came back. So I don't know what is going on. :)

[TheDreamer]

Originally posted by TheDreamer
The [geticons] section should probably be named [getchannelicons]


Okay, that was sneaky....rg_config.pl sees getchannelicons and looks in geticons instead.

So, the bug is rg_config.pl changes "[schedule2sql]" to "[schd2sql]", but the section in prg.conf is "[schedule2sql]".

That explains why it couldn't find replaySchedule when I had set it to find it in a different place (forced to put a copy in each of my local directories...actually I made them symbolic links, so when I rebuild...I'll always have the latest version [and be able to revert back incase there's a problem...it happened once]).

The Dreamer.

[Lee Thompson]

Thanks Dreamer, I'll fix those [] reference names..

I'll look into defaultslot too.

[inkspoof]

Can someone help me with this? The below happens after I schedule a recording with ReplayGuide.

==================
Refreshing Ink ... Failed: 1 (DELETE FROM schedule WHERE replayid = '1';) Program terminated due to fatal error or condition. ***** Execute halted for ./schedule2sql.pl at 342 Complete
ReplayTV database update Failed: <PRE>UPDATE replayunits SET lastsnapshot = 1082677858 WHERE replayid = &apos;1&apos;;
1
==================

The actual recording does get scheduled too.

[ArtieMcD]

Got one minor issue to report with version 200.... If a replay has no scheduled recordings... Everytime you vist the replay guide, that replay is refreshed.. this happens for each and every click within the pages.

[Lee Thompson]

I'll look into that Artie... it probably actually sees it as a failure.

[Lee Thompson]

inkspoof: What database engine are you using?

[TheProgrammer]

First let me say thank you for a great utility, it has made my RTV experience much more rewarding. :)

However, while everything else seems to be working fine, I still repeatedly get "Icon Not Found" errors when trying to get channel icons. I know very little about Perl but examining the response content it appears that it is not redirecting (as I get an error 302 Object Moved).

Provider ID: 177947
Zip Code: 21061

Any ideas would be greatly appreciated.

RK

[roddie]

Hi all,

When I try to schedule a new recording, I get this message:

Slot not available on DVR at x.x.x.x.

Things used to work, and nothing has changed recently that I can think of. PRG seems to communicate with my ReplayTV fine, because I can get a TODO list and current recordings, but I just can't schedule for some reason.

I did just upgraded to build 200 from build 198 (I think it was 198), but I had the issue in the older version as well.

I'm also getting the "Could not find an icon" message when I run updatetvdata.pl - I've added my zip and provider ID to a [geticons] section in prg.conf, but I still can't get the icons.

Thanks for any tips!

Roddie

[moyekj]

Roddie, I have seen that message before but have been able to schedule most recordings without problems. I believe the couple of times I had this error I tried to schedule a recording using DVA 3.0 (patched unreleased beta version) and got a similar error there. So finally I used DVA 3.0 "remote" remote control (along with feedback from the screenshot.bmp screen dumps) to schedule the recording to get around the problem and that has always worked - though is a much slower method of remote scheduling (getting screenshot updates takes about 30 seconds each).

As far as the "Could not find an icon" message I've always had trouble with that too. To workaround the problem I always do the following in the cgi directory after I manually retrieve Datadirect listings:

perl datadirect2sql.pl
perl getchannelicons.pl

This updates the SQL perl database and the icons database.

[roddie]

moyekj,

Thanks for the reply.

I believe the couple of times I had this error I tried to schedule a recording using DVA 3.0 (patched unreleased beta version) and got a similar error there.

Odd - I don't have a photo partition, so I can't use the remote, but I will try DVA for scheduling just to eliminate PRG.

I just find it strange that it used to work, and suddenly stopped working (it stopped working before I upgraded PRG).

As far as the "Could not find an icon" message I've always had trouble with that too. To workaround the problem I always do the following in the cgi directory after I manually update my Datadirect listings:

I tried those two, and I still get the icon message when I run "getchannelicons.pl" manually. Weird.

[moyekj]

Can't really help you much, sorry. I haven't heard from Lee in a while... maybe he's AWOL?

Did you try scheduling via DVA 3.0?

[roddie]

Can't really help you much, sorry. I haven't heard from Lee in a while... maybe he's AWOL?
That's ok, I'll try to work with it until Lee gets back. Seems like it should be something pretty simple since all other communication with the ReplayTV works. I might even try recreating the device.

Did you try scheduling via DVA 3.0?
Not yet - Haven't really been home long enough to play.

Got the latest replaySchedule yesterday - Minor version..

[roddie]

UPDATE - I can schedule with DVA 3.0 and PRG works again suddenly.

I haven't changed a thing, I swear!

Still no channel icons, though.

[TheProgrammer]

I have given up on channel icons myself. Never got them to work and never got a reply here. Everything else is working great though and I am loving ReplayTV (old TIVO convert).

RK

[j.m.]

Originally posted by TheProgrammer
I have given up on channel icons myself. Never got them to work and never got a reply here. Everything else is working great though and I am loving ReplayTV (old TIVO convert).

RK

It is possible, even likely, that Zap2It changed its listing format slightly, thus, breaking getchannelicons.pl. It worked when I wrote it (and Lee expanded upon it). I will have a look at it and see if I can fix it.

[TheProgrammer]

Thanks, appreciate it.

The main problem I was having was in the redirection. I was getting an "object not found" result page as for whatever reason it wasn't redirecting to the real page.

RK

[TheProgrammer]

Sorry, I meant I was getting a 302 Object Moved result page.

RK

[Lee Thompson]

I'm not "back" yet but I just wanted to let people now I'm not dead and I haven't given up on PRG.

I've just been very very busy (and still am).

[inkspoof]

Alright... I'm at wits end here. I wanted to move my replayguide to another computer so I built it exactly the same as the first one. Same OS, same versions of perl and sqlite and everything, but now I keep getting the following:


Dispatching rg_refresh
rg_refresh v1.0 build 5 (Batch Guide Refresh Library) loaded.
Refreshing ReplayTV Schedule Data
rg_scheduler v1.1 build 108 (replaySchedule Schedule Resolver Module) loaded.
rg_scheduler SRM for replaySchedule by Kevin J. Moye and Philip Van Baren.
Refreshing Data for Steve
Insert Failed: database is locked(5) at dbdimp.c line 389 (INSERT INTO schedule (programid, replayid, firstrun, guaranteed, theme, recurring, manual, conflict, created, padbefore, padafter) VALUES ('12609', '1', 1, 0, 0, 1, 0, 0, '1094774400', 0, 0);)
Can anyone help? This looks like an SQLite problem???


UPDATE
Got it working. Narrowed it down to something screwy with DBD::SQLite. I got it working with version 0.31 instead of the current 1.07 on CPAN. What version of DBD::SQLite are you guys using?

[zabolots]

I've been running PRG for months without any problems and haven't changed anything on my side. Recently I've been getting errors updating the data. Here's the contents of the prg.log file. I also have a zip file with my na.xml and tvlistings (DB) files in case anyone with more debugging skills than I have can figure this out.

PRGData.zip (http://pages.ripco.net/~zabolots/misc/PRGData.zip)

PRG.LOG dump

[SIZE=1][FONT=courier new]
2004-10-28 16:53:25 ********************************************************
2004-10-28 16:53:25 Personal ReplayGuide:DataDirect XML to SQL Converter v1.2 (Build 41)
2004-10-28 16:53:25 Running as datadirect2sql.pl with PID 1512
2004-10-28 16:53:25 Remote Address: 127.0.0.1
2004-10-28 16:53:25 Console Output: Enabled
2004-10-28 16:53:25 rg_config v1.0 build 26 (Configuration Function Library) loaded.
2004-10-28 16:53:25 rg_info v1.2 build 103 (Database Initialization Library) loaded.
2004-10-28 16:53:25 rg_database v1.1 build 228 (Database Function Library) loaded.
2004-10-28 16:53:25 rg_common v1.1 build 223 (Common Function Library) loaded.
2004-10-28 16:53:25 Job started at 2004-10-28 16:53:25
2004-10-28 16:53:25 Database Connection Established! DBI:SQLite:tvlistings (DBI::db=HASH(0x24c2c1c))
2004-10-28 16:53:25 Checking DataDirect Feed (./na.xml)
2004-10-28 16:53:26 Depending on the speed of the machine this may take approximately 9 minutes.
2004-10-28 16:53:26 Deleting Rows...
2004-10-28 16:53:27 Table tvlistings purged
2004-10-28 16:53:27 Table channels purged
2004-10-28 16:53:27 Table castcrew purged
2004-10-28 16:53:27 Deleting Rows... Completed
2004-10-28 16:53:27 0: Reading DataDirect Feed (./na.xml)
2004-10-28 16:53:27 ./na.xml: First Pass...
2004-10-28 16:53:27 ./na.xml: Seeking Stations Block
2004-10-28 16:53:27 ./na.xml: Parsing Stations
2004-10-28 16:53:27 ./na.xml: Parsing Lineups
2004-10-28 16:53:27 ./na.xml: Seeking Program Block
2004-10-28 16:53:29 ./na.xml: Parsing Programs
2004-10-28 16:53:40 ./na.xml: Seeking Cast/Crew Block
2004-10-28 16:53:40 ./na.xml: Parsing Cast/Crew
2004-10-28 17:01:07 Done!
2004-10-28 17:01:07 ./na.xml: Added 47171 records of cast/crew information
2004-10-28 17:01:07 ./na.xml: Seeking Genre Block
2004-10-28 17:01:07 ./na.xml: Parsing Genre Data
2004-10-28 17:01:13 ./na.xml: Second Pass...
2004-10-28 17:01:13 ./na.xml: Seeking Schedule Block
2004-10-28 17:01:13 ./na.xml: Parsing Schedule
2004-10-28 17:02:37 ********************************************************
2004-10-28 17:02:37 ***** Failed: near ",": syntax error
2004-10-28 17:02:37 ***** (INSERT INTO tvlistings (tmsprogramid, tmsid, starttime, endtime, tuning, channel, title, subtitle, description, category, stereo, captions, episodenum, vchiprating, mpaarating, starrating, movieyear, repeat, movie, subtitled, advisories) VALUES ('SH6372460000', 11091, '2004-10-27 19:00:00', '2004-10-27 19:30:00', , 'FSCH', 'FOX Sports Net Across America', '', 'Limited Series. Regional sports news, features and profiles. (First Aired: 2004-01-19)', 'Sports non-event', 0, '', '', '', '', '', '', 0, 0, 0, '');) at record 6811
2004-10-28 17:02:37 ***** Program Abend: datadirect2sql.pl at 1294
2004-10-28 17:02:37 ********************************************************
[/FONT] [/SIZE]

[jameskollar]

I've been running PRG for months without any problems and haven't changed anything on my side. Recently I've been getting errors updating the data. Here's the contents of the prg.log file. I also have a zip file with my na.xml and tvlistings (DB) files in case anyone with more debugging skills than I have can figure this out.

I don't run RPG, but if the log is correct, it "looks" like the error is that the Fox Sports channel is missing the channel number.

The SQL at error is the red in the SQL:

VALUES ('SH6372460000', 11091, '2004-10-27 19:00:00', '2004-10-27 19:30:00' [COLOR=red], ,[/COLOR]'FSCH', etc.

This correspsonds to the field tuning in table tvlistings.

Try deleting this channel from your lineup. The fact that this happened at line 6811 in the database load is a good sign that the rest of the data may be intact.

[zabolots]

Originally posted by jameskollar

Try deleting this channel from your lineup. The fact that this happened at line 6811 in the database load is a good sign that the rest of the data may be intact.

Well that worked. It's very strange that it worked fine for months but now I'm having this problem.

What's even more strange is that I don't see in the na.xml file where a station is mapped to a tuneable channel for ANY of the stations in the file. How does PRG map a station in the XML file to a channel number that replay must tune to for recording? The stations are defined in the xml file as

[FONT=courier new]
[SIZE=1]
<station id='11091'>
<callSign>FSCH</callSign>
<name>Fox Sports Chicago</name>
<affiliate>Sports Regional</affiliate>
</station>
[/SIZE][/FONT]

The channel definition above is the one causing me problems but it doesn't appear any different from any of the other channels in the file. Nowhere does it get mapped to channel 38, which is where this station appears on my local cable system.

Scott

[zabolots]

Just a quick update.
The problems I was seeing must have been related to a cable lineup change that went into effect on Nov 1. What was on channel 38 moved to 91 and was replaced with a different channel. The problems must have been caused by internal zap2it changes preparing for the lineup switch as now that it's gone into effect both channels are included in my DataDirect download and I'm not having any problems.

Scott

[homer stanford]

Today I received the following error message using Personal ReplayGuide:DataFeed Update Client v1.0 (Build 22)

Terminating Database Connection from DBI:mysql:tvlistings (DBI::db=HASH(0x8ea790))
Job finished at 2004-12-18 10:05:09 (313 seconds)
Dispatching rg_refresh
rg_refresh v1.0 build 5 (Batch Guide Refresh Library) loaded.
Refreshing ReplayTV Schedule Data
rg_scheduler v1.1 build 108 (replaySchedule Schedule Resolver Module) loaded.
rg_scheduler SRM for replaySchedule by Kevin J. Moye and Philip Van Baren.
Refreshing Data for living Room
*ERROR* ./dd.xml not in DataDirect format... aborting
getFreshScheduleTable Failed for living Room
Refreshing Data for Sitting Room
*ERROR* ./dd.xml not in DataDirect format... aborting
getFreshScheduleTable Failed for Sitting Room
Refresh Complete
Returned from rg_refresh

[TheDreamer]

Zap2it made a change to the datadirect format back on December 8 or 9th....upgrade replaySchedule to version 116.41 to cope with the change.

http://replayguide.sourceforge.net/replaySchedule/

The Dreamer.

[homer stanford]

Thanks Dreamer

[roddie]

I'm thinking of porting PRG from Perl to PHP in my spare time basically so that I can learn some of each language a bit better.

The most I've done in either language over the years is just to hack up existing scripts. I don't have the patience to go through beginners tutorials, so I figured this would keep me busy for a while and at the same time, since I use PRG a lot, it would keep me interested.

For those that are familiar with the source and structure of PRG - Is this something that would be possible or too difficult? Are there any major negatives to the idea? Can anyone suggest a place or file to start with?

Also, I figure if I can successfully do this, it might generate some interest in further development of the project.

If Lee is still lurking - Do you have any advice?