delimited

search for more blogs here

 

"How to perfrom summation for particular delimited field?" posted by ~Ray
Posted on 2008-01-02 00:18:46

Hi,gratify back up to share your thought about how to perfrom summation for particular delimited field and output to the particular file based on -rw-r--r-- 1 abc other 3094 Oct 19 09:40 0132019832-ps5_online_cdrm unl-rw-r--r-- 1 abc other 1588 Oct 19 09:47 0132019832-ps5_online_cdrn unl-rw-r--r-- 1 abc other 2523 Oct 19 09:54 0132019832-ps5_online_cdro unl-rw-r--r-- 1 abc other 947 Oct 19 10:01 0132019832-ps5_online_cdrp unl-rw-r--r-- 1 abc other 1300 Oct 19 10:09 0132019832-ps5_online_cdrq unl-rw-r--r-- 1 abc other 410 Oct 19 10:16 0132019832-ps5_online_cdrr unl-rw-r--r-- 1 abc other 4253 Oct 19 10:23 0132019832-ps5_online_cdrs unl-rw-r--r-- 1 abc other 10195 Oct 19 10:31 0132019832-ps5_online_cdrt unl-rw-r--r-- 1 abc other 1053 Oct 19 10:38 0132019832-ps5_online_cdru unl Each file will have content like this in which separated with delimiter "|". 1603823|010|4|CDR|0132019832|||3002|0194212739|||||||N|Y|Y|2007-08-30 23:42:42|||17||-0.1|16.5951|||MO019|-0.1|16.5951|0|||1603863|010|4|CDR|0132019832|||3002|01997564444|||||||N|Y|Y|2007-08-30 23:42:53|||14||-0.1|16.4251|||MO019|-0.1|16.4251|0|||1603912|010|4|CDR|0132019832|||3005|0135305303|||||||N|Y|Y|2007-08-30 23:43:07|||9||-0.1|16.1851||3GMid|MO013|-0.1|16.1851|0|||1603930|010|4|CDR|0132019832|||3002|0192504561|||||||N|Y|Y|2007-08-30 23:43:13|||17||-0.1|16.0851|||MO019|-0.1|16.0851|0|||1603948|010|4|CDR|0132019832|||3004|0126440226|||||||N|Y|Y|2007-08-30 23:43:18|||15||-0.2|15.8851|||MO012|-0.2|15.8851|0|||1603975|010|4|CDR|0132019832|||3007|0175152680|||||||N|Y|Y|2007-08-30 23:43:28|||13||-0.2|15.6151|||MO017|-0.2|15.6151|0|||1603996|010|4|CDR|0132019832|||3004|0125329005|||||||N|Y|Y|2007-08-30 23:43:34|||18||-0.2|15.4151|||MO012|-0.2|15.4151|0|||1604034|010|4|CDR|0132019832|||3005|0137508649|||||||N|Y|Y|2007-08-30 23:43:44|||11||-0.1|15.2451|||MO013|-0.1|15.2451|0||| The ultimate result of all values in field 24 will be summed up and output to file say a txt ,while field 5 and be sum determine must be separated by "|"Say when cat output(a txt)0132019832| -1.1be help...! awk 'BEGIN{FS="|"}{ a[$5]=a[$5]+$24}END { for (i in a) print a[i]"|"i > "outfile"}' "file"

Forex Groups - Tips on Trading

Related article:
http://www.unix.com/shell-programming-scripting/44274-how-perfrom-summation-particular-delimited-field.html

comments | Add comment | Report as Spam


"reading unicode tab delimited text file in php" posted by ~Ray
Posted on 2007-12-15 15:47:55

Hi All. Recently I'm involved with a task to read a tab delimited text file in unicode and then convert them into a series of sql insert statements and then insert to mysql db. I've successfully done the similar thing in the past with the text in ASCII using php's fgetcsv but this time it does not bring home the bacon for this unicode register. In the register it has some funny characters like '®'. Anyone had some hints on this? convey you very much. beat Regards,jim alter your object be formless. Shapeless desire water. If you put water into a cup it becomes the cup. You put water into a bottle and it becomes the store. You put it in a teapot it becomes the teapot. Now water can flow or it can come down. Be wet my friend. on tabs (\t) ?edit| or do you mean the characters are giving you problems? you can run html_entities() on it with the charset set Empty your object be formless. Shapeless desire water. If you put water into a cup it becomes the cup. You put water into a bottle and it becomes the store. You put it in a teapot it becomes the teapot. Now water can flow or it can come down. Be wet my friend. You cannot post new topics in this forumYou cannot reply to topics in this forumYou cannot alter your posts in this forumYou cannot delete your posts in this forumYou cannot choose in polls in this forum

Forex Groups - Tips on Trading

Related article:
http://forums.devnetwork.net/viewtopic.php?p=425939#425939

comments | Add comment | Report as Spam


"Plug-in for Excel-compatible, tab delimited file export." posted by ~Ray
Posted on 2007-12-09 14:21:18

Papers 1.5 is now available!! It comes with over 100 new features and bug fixes and it is compatible with your favorite big cat. Papers 1.5 Is a free update but will demand you to re-enter your registration details. transfer the modify. Dear members:After using Endnote v 7 for a while I have change state used to exporting libraries as tab dellimited files that I can then open with Excel. I haven't open such an export option in Papers. How can I merchandise a library in Papers in a change that can be opened in Excel while retaining its formatting ?convey you in go,Joseph Chamberlain This would be a nice small little communicate for anyone wanting to be at our plugin SDK. It's should be trivial. Have a be here: If not we'll undergo a look if we undergo time again (if the 1.5 update is out and all Leopard users are happy again ;-)

Forex Groups - Tips on Trading

Related article:
http://www.mekentosj.com/papers/forum/viewtopic.php?id=676&action=new

comments | Add comment | Report as Spam


"Diapered donors dodge delimited donations" posted by ~Ray
Posted on 2007-11-27 21:48:25

Finally a campaign scandal not just Hillary's! Underaged donors giving the maximum to Presidential campaigns is becoming a common way around race finance limits for candidates of both parties. : Just how much race cash is coming from children is uncertain -- the FEC does not demand donors to provide their age. But the be written by those identifying themselves as students on contribution forms has risen dramatically this year according to an analysis by the Center for Responsive Politics. During the first six months of the 2000 presidential campaign students gave $338,464. In 2004 that rose to $538,936. This year the be has nearly quadrupled to $1,967,111. "What's driving it is a desire by maxed-out donors to max out on their maxing out," said Fred Wertheimer president of race finance reform organization Democracy 21 who sought unsuccessfully to outlaw child donations five years ago. "More often than not you're dealing with populate who are simply trying to circumvent the limits of what they can give." Congress tried to disallow political contributions from those under age 18 as move of the McCain-Feingold Act in 2002 but the Supreme Court struck drink that provision as an infringement on the constitutional rights of minors. With that ruling in mind the Federal Election Commission wrote new regulations two years ago that tried to balance what it considered a legitimate desire among some children to make political contributions against the possibility that parents would seek to pad their donations by funneling money through children. The regulations established a three-step test to determine whether a contribution is acceptable: It must be made with the child's money the parent can not reimburse the child for making the donation and the contribution has to be knowing and voluntary. Read the whole story at the link above. Now. I think the Supreme Court decision was correct - minors shouldn't be prohibited from making truly voluntary political contributions with their own money. However that doesn't convey we should be suckers. Realistically the number of minors who would give the maximum donation out of their own money to a political candidate are very very few. You experience as well as I do most of these kiddie funds are from the parents or extended family members trying to circumvent the legal limits. But it's just the latest in a series of attempts to get around legal limits. People have been working around the limits ever since limits were first enacted in 1974. No matter how many times we've changed those laws and "tightened up the loopholes," donors act finding new and different ways to evade the limits which are completely arbitrary. Of cover they do - with the federal government spending $3 trillion every year and Presidents and Senators and Congressmen having a big say in who gets what of it there are thousands of populate and groups who wish to fix friendships with elected officials and one of the best ways to ensure a politician remembers your name is to create verbally his/her race a honkin' big check. That's why I'm against limits of any kind. The only restriction on donations to federal candidates should be that they come from American sources - citizens or corporations headquartered in America - and be instantly and fully disclosed before the money can be used by the campaign. If George Soros wants to furnish Dennis Kucinich $1 billion to run for Moonbat-in-Chief let him - so long as it's publicly posted before it can be spent. If Halliburton wants to guarantee a Cheney campaign why not? - as desire as we know where his money comes from we can take that into consideration before voting. The entire idea that "money corrupts" is anti-American. This country is the Land of Opportunity - which for at least two centuries was universally understood to mean "the Opportunity to alter a Buck." Politicians who be to take graft will find a way to do it as Duke Cunningham and William Jefferson have demonstrated. Campaign funds undergo to be strictly accounted for - it's hard to even get your wife and kids on the payroll anymore much less the in-laws and hangers-on in your "posse" - and don't represent the big ol' piggy banks they once did. For centuries we had no limits on individual contributions delayed paperwork reporting them that was inaccessible to most citizens and rarely submitted before an election and had fewer outright crooks in office than we find now. It's not the money. dulcify it's the man. In 1968 (as I've noted before over on ). Senator Eugene McCarthy's upstart antiwar campaign against a sitting President of his own party was financed mainly by three individuals who gave him over $1 million each (one gave $3 mil). If not for that money. McCarthy couldn't have run wouldn't have embarrassed LBJ in New Hampshire to compel him out of the race etc. Yet no one ever insinuated that McCarthy was tainted by the rich men who backed him. In fact the Senator's call was "Clean Gene," because of his supposedly high ethical standards. The easiest way to cut down on rule-breaking is to reduce the number of rules. We could do that and increase openness in campaigning with a few simple changes and then maybe two year-olds won't have to max out political donations out of their college funds. There's almost no way to be a parent is reimbursing a child for contributing. And since the caps are arbitrary anyway furnish dependent children a different cap. $250 for 4-12 and $500 for 13-17. This at least mutes the problem somewhat. And there's no way I'd undergo change surface those sums of money to spare out of what was truly my money at those ages. Otherwise with a cap system in displace you furnish advantage to those willing to circumvent the rules and punish those who follow them. And yes that's the problem with regulation once you start you often can't do just a little. Or the system ordain be grossly exploited. Posted by jpm100 | October 24. 2007 6:06 AM | Score: 1 (1 votes cast) A "child" under 17 is legally incapable of making contribution just as s/he is incapable of making a contract. It is irrelevant whether or not any "reimbursement" is made -- that's a pure fiction unless there is some minor out there with an independent fortune managed by an independent trustee who doesn't ask with the minor's parent(s)-- a remote possibility. I agree that this is the product of spending limits on individuals and another twist that keeps the FEC and election law lawyers in business. No limit full disclosure and PACs and 527s would be out of business. Posted by | October 24. 2007 8:58 AM | Score: 1 (1 votes direct) I can't accept the WaPo is targeting and smearing and stalking these poor families desire this. Shameful. Posted by | October 24. 2007 9:21 AM | advance: 1 (1 votes direct) Good surprise Mike. I be forward to OUTRAGE by mantis and the rest who were OUTRAGED by Michele Malkin. As for campaign finance ameliorate alter any size donation legal as long as all donations are disclosed. I could probably even be convinced to accept foreigners to donate so we could see who donated to whom. So did her sister and brother. Imara. 13 and Ishmael. 9 and her cousins Chan and Alexis both 13. Altogether according to newly released campaign finance reports the extended family of Williams a wealthy Chicago financier handed over nearly a dozen checks in walk for the maximum allowed under federal law to Obama. So explain how a 2 year old earned the money and made.

Forex Groups - Tips on Trading

Related article:
http://wizbangblog.com/content/2007/10/23/diapered-donors-dodge-delimited-donations.php

comments | Add comment | Report as Spam


"ASP Free Forums - 2 dimendional array from a delimited string" posted by ~Ray
Posted on 2007-11-17 17:30:08

Discuss 2 dimendional array from a delimited string in the ASP Development forum on ASP Free. 2 dimendional array from a delimited arrange ASP Development forum discussing ASP related topics including coding practices. ASP tips and more. Active Server Pages (ASP) enables you to appoint your HTML pages dynamically with robust scripting options. Ziff Davis Enterprise Virtual Tradeshows: Hot Topics. Cutting advance Technology. Real-time Interaction with IT Professionals. hit the books more at str = "1=1|2=2|3=3|4=4"arr = split(str. "|")arr2 = change integrity(arr. "=")Response. Write isArray(arr) & "<br />"Response. Write isArray(arr2) & "<br />" Is the a built-in ASP function to bring home the bacon what I am after or is this something that I will be to create a special finction in my cocde to achieve?Any help is appreciated. I evaluate websites using:Internet Explorer 5.5. 6.0 & 7.0. FireFox 2.0. Opera 9.2. Safari 3.0 on Windows XP Pro SP2 - Maybe overkill but I open it to be necessary on websites I buildI'm also working on building a Linux OS'd PC to test from.... <%ReDim myArr(1,1)str = "1=1|2=2|3=3|4=4|5=5|6=6"arr = split(str. "|")Response. create verbally isArray(arr) & "[" & uBound(arr) & "]<br />"For i = 0 to ubound(arr)Response. create verbally arr(i)arr2 = change integrity(arr(i). "=")Response. create verbally isArray(arr2) & "[" & arr2(0) & " | " & arr2(1) & "]<br />"Redim Preserve myArr(1,i)myArr(0,i) = arr2(0)myArr(1,i) = arr2(1)NextResponse. Write isArray(myArr) & "<br />"For i = 0 To uBound(arr)Response. Write myArr(0,i) & "+" & myArr(1,i) & "<br />"Next%> JBuilder® 2007 brings the cater of accelerated development tools to the brood platform with its renowned RAD and team collaboration capabilities making development fast and reliable for Java™. EJBs and Web applications. It provides all the economic benefits of an change state source platform with the reliability of a trusted turnkey solution provider. JGear Performance for brood delivers a performance-related profiler for memory and CPU profiling and debugging. Data is displayed in real time that allows developers to understand whether a performance issue is related to CPU memory or both. An Automatic Memory Leak Detector monitors for immediate identification of potential memory leaks. IBM® Workplace™ for SAP® Software leverages existing SAP investments to back up alter people productivity by integrating SAP circumscribe with IBM leading collaboration and performance management technology. SAP and IBM capabilities are combined into role-based high performance bring home the bacon environments. IBM® Lotus® Expeditor software is IBM's universal managed client software to increase composite applications to laptops desktops kiosks and mobile devices. It can be used to extend your IBM Lotus. IBM WebSphere or Eclipse™ infrastructures to a managed client environment. WebSphere® entertain Access Transformation Services (HATS) transforms terminal applications quickly and easily. With HATS you can act Web and rich client applications that give an easy-to-use graphical user interface (GUI) for your character-based 3270 and 5250 host applications. IBM Lotus® Forms Express 3.0 helps mid-market organizations quickly and easily act intelligent Web-based forms without Web programming skills which helps accelerate business transactions and reduce operational costs. Business function Management (BSM) has emerged as an approach to help IT mouth clear business value amidst increasing complexity and constant pressure to reduce costs. BSM and network management software solutions built with proprietary code have proven to alter poorly to the changing IT adorn despite their center prices. While call centers are essential to thousands of businesses many suffer from high operational costs. Increasingly organizations are discovering how to improve results by allowing capacity to be added on-demand. In this color cover see how elasticity will make your call bear on a more valuable resource and positively affect your furnish line. Novell makes it easy to consolidate your Windows applications and other legacy services with the innovative SUSE® Linux Enterprise Virtual Machine Driver case and its underlying Linux server. You’ll achieve near-native performance of your virtual systems increase the life of your software investments and decrease infrastructure costs. This inform from the Cost Xpert Group examines the productivity benefits of using commercial Eclipse-based Java IDE products from IBM (IBM Rational Application Developer). Genuitec (MyEclipse) and CodeGear (JBuilder) compared to the freely downloadable baseline Eclipse configuration.

Forex Groups - Tips on Trading

Related article:
http://forums.aspfree.com/classic-asp-development-5/2-dimendional-array-from-a-delimited-string-193700.html

comments | Add comment | Report as Spam


"Scalix Server :: RE: SPAM problems" posted by ~Ray
Posted on 2007-11-09 19:08:56

All,We are currently having a lot of issues with e-mail and the be being received. We are using Spam Assassin and everything is up to go out on our server. A lot of messages go in and are labeled SPAM however there are quite a few that are not and we have to keep "training" our server to label them as such - it really is becoming an air. One solution we are talking about integrating is to block emails from unknownand unverified addresses. AKA sender communicate verification. Companies such as Sendio and Digiportal offer this write of e-mail blocking. Does anyone use this write of product with their email servers? If you do what are your suggestions for purchasing?Or the alternative is to back up fix the e-mail problem with Spam Assassin but what can I do? Do you guys just use e-mail Assassin or do you have something else set up along with it? I update it and it is completely set up correctly. I am looking for advice as to what my next go should be in fighting this SPAM air. Thank you Hi,Personally I evaluate these types of products are a expend of time because they create a lot of break up messages. For example for every spam communicate coming into the system the system will displace a verification message. This is choose of ok if the message can't get to the destination but if the spammer forged the sender address you ordain possibly send these emails to innocent third parties. Indeed there are blacklists for just this sort of thing. We had a similar problem at work and implemented SpamTitan which is a spam appliance write solution but you can deploy it on your own hardware. The other thing to implement good do is to try and stop messages coming into your system - i e being accepted by SMTP if the communicate is unknown. Using Scalix and SpamTitan it is possible to ensure that only telecommunicate going to addresses which exist in the Scalix directory are ever accepted by the gateway and this has actually really helped the be of spam we acquire daily. Andrew. I took a new come.. block it at the firewall. I looked up and researched Africa/Asia/Amsterdam/SouthAmerica and blocked them all. This might appear a little region prejudice but the create is in the results. Last month. 700,000 messages and this month. I'm predicting 300,000. My firewall goes by the contradict all allow this mindset. So all I had to do was put in multiple rules that allowed from the allowed public IP ranges that I wanted. It's working desire a charm... I comfort get junk but mostly from telecommunicate modem and DSL hijacked PC's. accept All Send telecommunicate (SMTP) 168.8.28.2 (LAN) WAN Allow All Send Email (SMTP) 204.0.0.0 - 209.255.255.255 (WAN) 168.8.28.2 (LAN)Allow All displace Email (SMTP) 223.0.0.0 - 255.255.255.254 (WAN) 168.8.28.2 (LAN)accept All displace Email (SMTP) 214.0.0.0 - 216.255.255.255 (WAN) 168.8.28.2 (LAN)accept All Send telecommunicate (SMTP) 197.0.0.0 - 199.255.255.255 (WAN) 168.8.28.2 (LAN)accept All displace telecommunicate (SMTP) 191.0.0.0 - 192.255.255.255 (WAN) 168.8.28.2 (LAN)Allow All Send Email (SMTP) 127.0.0.0 - 188.255.255.255 (WAN) 168.8.28.2 (LAN)Allow All displace Email (SMTP) 96.0.0.0 - 115.255.255.255 (WAN) 168.8.28.2 (LAN)Allow All displace telecommunicate (SMTP) 63.0.0.0 - 76.255.255.255 (WAN) 168.8.28.2 (LAN)accept All Send Email (SMTP) 42.0.0.0 - 57.255.255.255 (WAN) 168.8.28.2 (LAN)accept All Send Email (SMTP) 0.0.0.1 - 40.255.255.255 (WAN) 168.8.28.2 (LAN)_________________Karl McElwainBanks County School SystemIf you look hard enough you can find it for remove. We use sendmail as the MTA with a daily automtically generated whitelist from all Scalix contacts (just domains) and all domains sent to (from all sendmail logs) - with some study telecommunicate domains removed. This is done via a bash compose. Also use several DNSBL in sendmail on all non-whitelisted merchandise to evaluate delivery as well as the accost delay and delay checks/spamfriend features in sendmail. Sendmail is also setup to auto report spam items to spamcop net. (this only works on the addresses that spammers undergo made up on our domain)The ammount of e-mail to users is now very minimal. Also ClamAV is plugged into Sendmail here is the compose to alter a sendmail whitelist: #!/bin/sh# /etc/cron daily/generate_whitelist## TODO: # make old maillogs be gzipped# be inside gziped maillog files# CONNECT: list# rename the itermediate files to something with a stnd affix and exceed location.# make portable with variables defined in the header## In all this entire script now takes 3 minutes.#echo "# /////////////////////////// WHITELIST GENERATE go away /////////////////////////// #"wget -q http://send. DOMAIN com/api/sxadmin@DOMAIN com/mailbox/Public%20Folders/DOMAIN%20Contacts/?create=vcard --http-user=sxadmin --http-password=password -O - > /root/DOMAIN_contacts_vcard txtfor i in $(/opt/scalix/bin/omshowu -m all -i | sed '/@/d; /x/d'); do wget -q http://send domain com/api/"$i"@domain com/mailbox/Contacts/?create=vcard --http-user=mboxadmin:sxadmin:"$i" --http-password=password -O - >> /grow/domain_contacts_vcard txt donefgrep -i "EMAIL;write=OTHER;" /root/domain_contacts_vcard txt | cut --delimiter=";" -f3 -s | tr [:upper:] [:lower:] | tr -d [:blank:] | sort | uniq > /grow/DOMAIN_contacts_emails txtecho ""echo "All email addresses from all DOMAIN and personal contacts:"wc -l /root/domain_contacts_emails txt### This gets all the unique domains from the enumerate of contacts email addresses#cat /grow/domain_contacts_emails txt | cut --delimiter="@" --only-delimited --fields=2 | choose | uniq > /grow/domain_contacts_whitelist txtecho ""echo "All domains from all DOMAIN and personal contacts' email addresses:"wc -l /grow/domain_contacts_whitelist txt### This scans the sendmail logs for addresses that undergo been sent email from the# DOMAIN domain and gets the lie and forgets the first move of the line upto the to= (and also clean up the communicate too)#fgrep -i " to=" /var/log/mail* | cut -d= -f2 -s | tr ",;" "\n" | cut --delimiter="<" --only-delimited --fields=2 | cut --delimiter=">" --only-delimited --fields=1 | sed "s/^[']*//" | sed "s/['.-]*$//" | tr -d [:blank:] | tr [:upper:] [:displace:] | sort | uniq > /root/raw_sendmail_email_addresses txtecho ""emit "All email addresses from sendmail logs that DOMAIN has sent telecommunicate to:"wc -l /root/raw_sendmail_telecommunicate_addresses txt### This finds the addresses from restricted domains (likely for being in DNSBL or actually are) and # makes a whitelist of email addresses (that have had telecommunicate sent to them from the domain com domain).#cat /grow/raw_sendmail_telecommunicate_addresses txt | sed "s/^[']*//" | sed "s/['.-]*$//" | grep 'yahoo\|hotmail\|gmail\|aol' | sed -e 's/^/from:/' -e 's/$/\tOK/' | sort | uniq > /root/addresses_sendmail_whitelist txtecho ""emit "All telecommunicate addresses from sendmail logs from certain domains put into sendmail-access format:"wc -l /root/addresses_sendmail_whitelist txt### This cleans up the sendmail log grep to be just the unique 'to:' domain names.#cat /grow/raw_sendmail_email_addresses txt | cut --delimiter="@" --only-delimited --fields=2 | tr -d [:blank:] | tr [:upper:].

Forex Groups - Tips on Trading

Related article:
http://www.scalix.com/forums/viewtopic.php?p=39815#39815

comments | Add comment | Report as Spam


"Paper Towels and more website..." posted by ~Ray
Posted on 2007-11-08 15:29:55

Look for paper towels , linens, bath towels, and more at TowelTown.com
stop by anytime

comments | Add comment | Report as Spam


"Delimited List needs to be broken apart" posted by ~Ray
Posted on 2007-11-03 15:02:38

Hi all. Is it possible to break apart a enumerate of items into individual bits using hold on Morph or MivaScript?I'd like to be able to use a hold on alter aray to hold on and process these but it may not be possible - I might apply to javascript for this. Or perhaps. Javascript might be a good idea overall?Let me experience your thoughts - all are welcome tim. With MivaScript you can use Gettoken if the items undergo a consistant delimiter. Or use Len and SubString if its fixed lenth (its a tad complicated but doable). Exactly what are you looking to do? You can do it with MivaScript using the substring function while looping thru the delimeted enumerate looking for the delimeter and dumping the results into an array. If I am reading your challenge correctly you could use the Emporium Plus drive Kit to hold on the delimited enumerate into an array. Then use foreach to show that array. See #43 (vacreate) on this pageTo see an example of its usage go to and look at the list of actors which came from one custom product field. Powered by vBulletin Version 3.5.3Copyright ©2000 - 2007. Jelsoft Enterprises Ltd.

Forex Groups - Tips on Trading

Related article:
http://extranet.miva.com/forums/showthread.php?t=11461&goto=newpost

comments | Add comment | Report as Spam


"php or perl to import large tab delimited text files to mysql" posted by ~Ray
Posted on 2007-10-28 12:58:42

Hey everyone... I am an old BBS guy and military geek turned real estate broker who tries too hard sometimes learning - but I do be to understand - so gratify feature with me... I am a rather visual learner.. that said - I've got a basic on perl xml php and mysql... here is what my project is for the next bring together of days... Goal: Setup duplicate database coordinate (except using mysql on my servers) and data tables for about 15 tables. The provider of the data is a real estate related MLS function. The data is everything from the various listings (homes commercial etc) to office id's and other structures I might use in the future... I be to cerebrate my learning on 2 or 3 alter now... 1) data is provided to me via ftp in the form of tab delimited text files. It appears that for each table/data group - (for instance listings-residential txt) is a straight dump as of desire 4AM or so each day.. file is gz'd.. this particular register has some 6,000 daily rows and about 80 collumns many of which I am actually interested in saving long term.. this file does not undergo any updates on which listings/rows were removed from day to day.. this will need to be addressed in our compose as well to act my db accurate..2) conceive of files associated with each of these listings are zipped on the same ftp server daily the past 4 to 7 days of ziped pictures are available noted in the zip file name itself is the go out it was zipped.. as come up as a pictures-old gz that is about 750MB containing all the older pics we be to clutch and press into a server directory for our scripts to search.. the pictures are jpg mostly and are in the change of MLS#(relating to the mls # of the listing)x i e main conceive of is MLS###### jpg then additional pictures (if provided) are MLS######A jpg. MLS######B jpg etc.. this provider allows upto an additional 8 pictures so the last in the series is H... ( I mention all this as below I ordain ask a better way to concantonate the MLSprefix and trailing A-H as appropriate on the actual number move of the MLS number we select from the tables we create with the actual mls data move)....3)I undergo a lot of ideas - and I experience there are a lot of desire term DB maintenance items to not lose.. here is what I undergo seen done elsewhere and what I am looking at - basically I be a cron compose to run daily to grab these txt files and picture files extract them to appropriate directory and parse the text file merchandise to existing mysql databases. but I do not yet have the delay structures all setup alter - I do have a text file from the provider that shows the various collumn names and categories as well as lenght.. so far I undergo just been using manual delay creation - very decrease - and setting each collumn as varchar and 255.. perhaps I should be looking for exceed ways there too... So recap - I be to setup the tables from the txt files first.. then create verbally script to download and extract then merchandise to mysql.. if we get that far I ordain probably ask to hire ya for a bunco while to write some more stuff with me to actually use the data once we get it setup and storing the data daily.. like I undergo the ability to acquire data dumps from the county offices - I would desire to import that data to a database and furnish web interface for users searching the mls data to also cross cerebrate to the corresponding tax data - i e the compose when displaying mls info will try to automatically associate mls communicate as given with the data we acquire from the county office - if no claim be is found then furnish "come be or possible displace own selection to end user to pick or to browse/examine to get change by reversal data from the county).. but thats a ways down the road yet... Any takers on this communicate of exploit who don't mind taking donations now and then and can help me hit the books a little along the way?I will log in from dev pc to affix code in a moment for your review... I am a bit lost as to what is the better way to go - bash script to get the files and remove to proper directory or just use perl or perhaps php? I am bet for learning new things.. been looking at ruby and python.. but I am certainly no expert in any of them... this appears to do a lot of what I want.. compassionate to furnish feedback on it? I also have seen a bash script for the same... I will post here for review... This is Google's cached copy of mysql_txt_import_measure txt from explore is neither affiliated with the authors of this page nor responsible for its content. br sqlmysql_txt_import_measure txt #!/usr/bin/perl -wuse strict;use DBI;use CGI;use Net::SMTP;my @files;my @dbtables;####### CONFIG divide Variables ###########################my $debug='yes';# yes/no if dubug = yes if you be status of execution of script to be shown throught web my $dbname='kathi_jaykali';# mysql database namemy $host='localhost';# ip communicate or entertain of Msql servermy $port= '3306';# mysql portmy $user= 'kathi_jaykali';# mysql usermy $go= '*******';# mysql passwordmy $ftphost= 'idx fnismls com'; # ftp host for getting.

Forex Groups - Tips on Trading

Related article:
http://www.webdeveloper.com/forum/showthread.php?t=160007&goto=newpost

comments | Add comment | Report as Spam


"Character-Delimited Text File Viewer" posted by ~Ray
Posted on 2007-10-23 16:41:06

ForDelphi. Version 1.0 to 1.1 35 downloads Copyright: No significant restrictions Updated on Fri. 07 Sep 2007 12:00:27 GMTOriginally uploaded onFri. 07 Sep 2007 12:00:23 GMT You may still be able to repair the zip file contents if you download the entire zip locally. You may also be to ask the author to repost the attachment. "Character-Delimited Text File Viewer" is a utility that allows you to believe the contents of any character-delimited text register. Each row in the text register must undergo at most 27 discrete elements. You tell the utility the layout of the fixed-record register type (the name of each data element what the character delimiter is separating the data elements (comma or semi-colon or whatever) and how many data elements there are on each row) and then you can open any such file and view the contents in the proper context (the contents of the register is displayed in cells with discrete/atomic pieces of data in each cell).

Forex Groups - Tips on Trading

Related article:
http://cc.codegear.com/Item/24985

comments | Add comment | Report as Spam


"Re: Saving large MAT file as a tab delimited text file" posted by ~Ray
Posted on 2007-10-17 16:07:27

In bind <fb75sm$era$1@fred mathworks com>,Sunny <snanuwa@hotmail com> wrote: >is there a way to save a large MAT register i e 5000x5000 >elements to a tab delimited text register? dlmwrite(filename. M. '\t')Note: you may not be able to construe this into Excel: Excelspreadsheets are limited to 256 columns until Office 2007which is limited to 16384 columns-- If you lie to the compiler it will get its revenge. -- Henry Spencer

Forex Groups - Tips on Trading

Related article:
http://mathforum.org/kb/thread.jspa?messageID=5883025&tstart=0#5883025

comments | Add comment | Report as Spam


"Upload text delimited field" posted by ~Ray
Posted on 2007-10-10 17:39:56

I want to transfer a comma delimited text file that is structured desire:ID,go out,aggroup1,aggroup1label,aggroup1Score,Team2,Team2Name,Team2Score,DetailWhat I'd desire to do is have some PHP (and mySQL) that'd take that comma delimited register and insert it into the database and if the ID in the file is already in the DB to overwrite it. Any back up would be greatly appreciated. See and () for uploading and parsing the register. As far as overwriting the same ID in the DB be that column as the primary key and use "REPLACE" instead of "attach" for your query. __________________"I heard where it's a misery wrapped in an enema. That doesn't sound too good."-- Fred Colon in The Fifth Elephant by Terry Pratchett Powered by vBulletin® Version 3.5.7Copyright &write;2000 - 2007. Jelsoft Enterprises Ltd.

Forex Groups - Tips on Trading

Related article:
http://www.phpbuilder.com/board/showthread.php?threadid=10344525

comments | Add comment | Report as Spam


"Cells and call/cc. Or delimited continuations." posted by ~Ray
Posted on 2007-10-06 09:20:04

Here is a showing all the main programming paradigms and their relationships. This is quite different from the usual draw which just shows programming languages. This draw condenses a lot of information in a compact way. If your favorite language is not mentioned here make a convincing argument and I may add it. If you find any errors gratify let me know. I ordain act all populate's comments into account to improve the diagram. Note to Unix aficionados: the diagram was made using xfig running on Mac OS X. I accept (at least with the measure point) but my point is that there is no observable concurrent execution which seems to depart your assertion that a vat can be considered multiple threads with a deterministic scheduler. The lack of interleaved execution between objects implies no plan simply co-operative yielding. I'm just trying to harmonise your statements of E with what I know of E. Perhaps we have a terminology couple on 'threads' and 'schedulers'. As for preemption. I haven't read anything about covert channels via the scheduler so if you have any links I'd be very interested. As a final thought adjoin channels aren't much of a concern considering we can't change surface properly discriminate overt communication yet (on a mainstream platform at least so E and friends don't ascertain ;-) ). Joe-E may be the closest to achieving this. It seems that nearly every branch ends with Oz and Alice. Is this diagram intended to back up these languages or completely interpret the state of the universe of language paradigms? Finally the imperative programming lie looks thin. Surely the distinguishing features between the various imperative paradigms are larger than the presence/absence of closures threads and logs woudln't you say? Would you? I'm not Peter but I'll offer my opinion that talking about "various imperative paradigms" is an oxymoron. Some will say that object-orientation is a distinct imperative paradigm but that's problematic because objects are trivially modeled with closures and don't necessarily require mutation. So from my POV the imperative programming lie looks thin because it is. I don't evaluate that implies a determine judgment necessarily; you can alter the inform that once you undergo first-class functions and mutable express you can macro-represent almost anything else e g delimited continuations. Or you can indeed believe it somewhat pejoratively and say that while you might be able to do that it's difficult and error-prone relative to having a more orthogonal feature set that might be easier to cerebrate about and treating mutable express as one more extremely powerful easily abused hard-to-reason-about feature. The draw as presented supports both interpretations (and more!) equally come up so I evaluate it would be more fruitful to change state on some issues of accuracy that have already been raised e g. SQL not being Turing-equivalent. E not having "threads" (but perhaps "threads" is really just shorthand for "concurrency constructs," in which inspect the characterization of E is accurate) etc. Update: It's worth reiterating that this diagram is derived from the exposition found in which uses Oz as its vehicle in essentially the same way that uses Scheme. Unlike SICP however. CTM provides an extensive analysis of how the paradigms introduced appear and are used in other languages such as Java. Haskell and Erlang. CTM builds up its definition of Oz by starting with a tiny kernel language and very gradually adding features until the kernel is beat Oz needing only syntactic dulcify in order to be the "real" Oz. The result is that each new kernel feature is strongly motivated by a combination of comparison to other languages and the requirement that the new feature not be implementable by other means without requiring non-local changes to the label. In this way it becomes easy to understand why Oz is what it is and crucially why it really is a multiparadigm language with a level of orthogonality that other multiparadigm-in-practice languages e g. C++ and OCaml unfortunately lack. I cannot recommend either the schedule or the language highly enough. multiparadigm if one can schedule in each paradigm without interference from the other paradigms. It's not sufficient to implement many programming concepts. E g.. Common Lisp contains many concepts but it is not multiparadigm in this comprehend. dual paradigm. That seems to furnish very nice results. For example. Prolog implements both logic programming and imperative programming. Modern constraint modeling languages (like Comet and Numerica) alter upon Prolog: they are both constraint languages and object-oriented languages. The constraints are the engine and the object orientation is for structuring problems. Whereas all other functional programming languages are based on the application of functions to arguments. Joy is based on the composition of functions... The concatenation of allot programs denotes the composition of the functions which the programs denote... Some functions expect quoted programs on top of the stack and kill them in many different ways effectively by dequoting. So where other functional languages use abstraction and application. Joy uses quotation and combinators -- functions which act dequotation. As a prove there are no named formal parameters no substitution of actual for formal parameters and no environment of name-value pairs. We must be our terms certainly. Since the diagram is explicitly inspired by CTM. I'll use the definition from CTM. Unfortunately my write of CTM is currently on give so we'll undergo to wait for its return or for some other kind soul to affix the definition from CTM before we can really view the draw in the context of that definition. That's not to say that Wikipedia's is bad/wrong; I merely desire to relate the draw to its source of inspiration at which inform we can address whether that obtain is reasonable or not. "A computation model is a formal system that defines how computations are done. There are many ways to be computation models. Since this book is intended to be practical it is important that the computation model be directly useful to the programmer. We therefore define it in terms of concepts that are important to programmers: data types operations and a programming language. The call computation model makes precise the imprecise notion of "programming paradigm." The be of the book talks about computation models and not programming paradigms. Sometimes we use the evince "programming model." This refers to what the programmer needs: the programming techniques and create by mental act principles made possible by the computation model." Typing is orthogonal to what the diagram expresses. Typically each paradigm can be done with different styles of typing (varying degrees of static or dynamic typing). The orthogonality is not perfect: typing can alter expressiveness. I would be happy to see a diagram that takes the influence of typing on expressiveness into be! Aspects are also orthogonal to the diagram. Aspects are parts of a specification (a program does A /\ B /\ C etc. where A is the functionality. B is an aspect. C is an aspect etc.) so they bear on to all paradigms. Aspects are certainly not limited to the 'aspect' create in AspectJ! As for the draw itself. I think a exceed perspective is to do by the particular programming languages that are attached to the nodes - as that tends to create passion. The exceed question is whether PvR has managed.

Forex Groups - Tips on Trading

Related article:
http://lambda-the-ultimate.org/node/2410#comment-36381

comments | Add comment | Report as Spam


"Value delimited fields" posted by ~Ray
Posted on 2007-10-03 18:56:10

I'm in the affect of working on a migration strategy to get the Igloo off of the platform and onto. My search of the internet provided few resources beyond to back up me with the data assign. I played around with BlogML but in the end wasn't able to get it to bring home the bacon quite desire I wanted so I started working on my own solution. After screwing around for a while I was working on writing the compose to move the comments from one database to the other when I hit upon something that astonished me. One of the first jobs that I had out of school was working on a WinForms application that used a SQL 6.5 database for the approve end. That database had been designed by a bring together of populate who's measure data create by mental act efforts had been in a pure value delimited data store. As a result there were columns that had many different logical values stored with a delimiter of something like char(152). As a prove if we wanted to inform or affect based on any one of those values we had to know the location in the delimited handle. Above all things this was the most painful undergo I ever had as a data consumer. Instead of easily being able to run a SUM and GROUP BY query against the database we would have to displace the values individually and then loop over them processing the grouping and summary manually prior to pushing the results to something like Crystal Reports. Painful. Brittle. Frustrating. I couldn't believe it when I saw it again. To convert the comments out of the Community Server database I had to acquire the comment author and their URL if either had been provided in the original comment. Community Server (at least version 2.0 which I am using) stores those values in an undelimited column called "PropertyValues". What you get is something that looks desire this: How do I know where to get the start of the author label on row 1 and still be able to get the go away of the compose label on row 2? It doesn't be if you're consuming this into a inform a sql ask or an application there has to be a way to split that string into its respective logical values (URL comment compose posted spam value). In my discourage and search for patterns or parsing information I end up looking through a lot of the comment entries and I notice something change surface more frustrating. The data in the "PropertyValues" column is not necessarily in the same request. For dilate: In the end you have two numeric values. The one open in go be 3 is the starting index for the comment compose determine that is stored in the "PropertyValues" column. In the case of the samples above the first mention compose determine starts on list 0 (adjust) and the second one starts on list 33. The back up value open (go number 4) is the length of the determine representing the comment compose. The first example above has a length of 14 and the back up has a length of 9. Once you undergo those two values you can simply use the T-SQL SUBSTRING function to get the data you need. The exact same principle can be used for getting the URL value. Simple huh? I had a belief that the people at were pretty smart. Unless there is some good cerebrate for making me be a data contortionist I'm starting to conclude otherwise. Why couldn't and his coworkers go up with a exceed solution than this in version 2.0 of this product? If they were worried that they may be to add more properties and didn't be to undergo to alter the database coordinate every measure that they did why not act a child table that has the post id property id and property value columns in it? Turning the data vertical instead of trying to hold on it horizontally would furnish them all the expansion room that they be. Instead we end up with this exclusionist data coordinate that prevents the outside people from getting any use out of it. What if I wanted to act a component for my blog that showed the people who have commented the most? There's no way for me to create a simple component that can do this. I have to go through the act of getting all the comments back in a dataset parsing each one to find the commenter name and then manually ascertain and group the values. Painful. What I should be able to do is something desire this: I see no cerebrate that data find in this inspect can't be this easy. With the power of relational database engines and the low be of storage space no database designer should be able to confirm a determine delimited column over a normalized data structure. There's also no cerebrate not to move away from it. Every Community Server upgrade that I've performed has included a significant set of database upgrade scripts. You could change the data coordinate to something more user friendly and modify the application to work with it. move of the database grade scripts then could consider a divide that migrates all the data from the old "PropertyName"/"PropertyValue" format into the new data structure. Voila. determine delimited columns gone. Howdy,I agree a key/determine delay would certainly be much easier to manage from an external app. And it was one of the first questions I asked ScottW when I started working on the CS aggroup. The reason he chose to go with the serialized format when developing CS 1.0 was database performance on large sites. When reading a affix (or blog etc) it's easier to just construe in that one row and deserialize the extended attribs in C# rather than search on many rows in a settings delay. As I understand it that is the same reason Microsoft chose to use that serialized format for storing extensible profile properties in the ASP. NET 2.0 membership schema. In fact we adopted the claim same format they used for CS extended attributes so there would at least only be one format to deserlialize instead of two. In most cases if you wanted to act a component for your blog you would use the CS API or a web function rather than accessing the database directly which handles the seralizationd affect for you. So all you undergo to do is something desire WeblogPost. GetExtendedAttribute / SetExtendedAttribute. Of course there are times when I'm writing sql scripts especially for reports and such when I be to read specific extended attributes and sure wish it was simpler. =) But there is at least a SQL Server function that Scott wrote which makes that fairly painless. You can clutch it here:http://communityserver org/files/folders/label_snippets/entry538737 aspxGood luck in your migration. @Kevin -- Thanks for the explanation. I don't buy it for one second though. Who cares if Microsoft does it for the membership schema? How does their use of a questionable learn belong to the implementation on your or anyone else's software? I also am very dubious of the affirm that serializing and storing data in a CLOB is the only way to write a performant data store. If that were the case every large database in enterprises around the world would consist of Table_1 which only contained Column_1. I've been on a communicate where this write of data storage was mandated and the only thing that was gained was development speed. You can't argue that it's not faster to create verbally a CRUD forge that has only one delay and column to bring home the bacon against. Regardless of the arguments for and against using this data storage technique in the past why would it be allowed to continue into current versions? There are dozens of ways to alter the label and storage simple for accessing values from a settings table. Try nHibernate iBatis or any other ORM. Anyways.. enough on that. I'm off to run some final tests for my migration..

Forex Groups - Tips on Trading

Related article:
http://igloocoder.com/archive/2007/08/22/1290.aspx

comments | Add comment | Report as Spam


"Reformatting a tab delimited file in Perl" posted by ~Ray
Posted on 2007-09-30 17:43:14

I have a command which outputs tab delimited information. The be of columns and rows dress based on the command I run and there are hundreds of commands. I need to remove each column from this register and print them into a new text register but have each column stacked on top of the other. Any help on getting this done would be greatly appreciated. I do not be to use any perl modules. No Text::CSV. What do you mean by stacked on top of each other? Do you mean one per line or convert the tabs to a space? Either way it seems desire a simple search/replace would be the way to go... #!/usr/bin/perlwhile (<>) { $Line=$_; $lie =~ s/\t+/\n/g; # dress the \n to whatever burn you want as a separator create $Line;} OK this is a bit more programming than I entangle like doing before lunch but it should be a good starting inform anyways.... #!/usr/bin/perl$LineNum=1;@LineData=();%Data=();while (<>) { $lie=$_; chew $lie; # put values from a line of data into an array @LineData=split (/\t+/,$Line); $LinePos=1; foreach $determine (@LineData) { # put each value into a hash delay. $Coords=$LinePos. "x" . $LineNum; $Data{$Coords}=$determine; $LinePos++; } $LineNum++;}# create a row of alter values so that there ordain be a newline between each set of records.$NumFields=$LinePos-1;for ($Num = 1; $Num < $NumFields; $Num++) { $Coords=$Num. "x" . $LineNum; $Data{$Coords}="";}# do the sorting and print everything out foreach $Coord (choose (keys %Data)) { create "$Data{$Coord}\n";} Note that this ordain pull the entire dataset into memory so if you are talking about huge data files this would need some optimization.

Forex Groups - Tips on Trading

Related article:
http://www.aota.net/forums/showthread.php?threadid=23087

comments | Add comment | Report as Spam


 

 




blogs - aa blogs - air force blogs - aquarius blogs - aries blogs - army blogs - arts blogs - baby blogs - blogs 4 men - blogs 4 women - cancer blogs - capricorn blogs - career change blogs - choice blogs - christmas blogs - cigar blogs - cigarette blogs - cig blogs - coast guard blogs - coffee bean blogs - college baseball blogs - college basketball blogs - college football blogs - colleges blogs - computer blogs - create blogs - dating blogs - elvis blogs - email chat blogs - email pal blogs - enhancement blogs - fall blogs - fha blogs - freedom blogs - friendly blogs - funny blogs - gambler blogs - gemini blogs - her blog - his blog - hockey blogs - join blogs - javas blogs - kid safe blogs - leo blogs - libra blogs - apartments blogs - coffees blogs - horoscopes blogs - life advice blogs - lover blogs - marine blogs - married blogs - military blogs - misc blogs - more money blogs - mortgage blogs - move blogs - movies blogs - musical blogs - navy blogs - new in town blogs - obscure blogs - online date blogs - online game blogs - over 30 blogs - over 40 blogs - over 50 blogs - over 60 blogs - over 70 blogs - over 80 blogs - over 90 blogs - password blogs - pc blogs - mortgages blogs - peoples blogs - pictures blogs - pipe blogs - pisces blogs - poems blogs - poker blogs - police blogs - political blogs radio blogs - read blogs - recreational vehicle blogs - relocation blogs - reserve blogs - rv blogs - safe blogs - scorpio blogs - singles blogs - smokers blogs - smoker blogs - state blogs - state college blogs - taurus blogs - teen advice blogs - teenager blogs - tobacco blogs - tv blogs - vacation blogs - veteran blogs - virgo blogs - virtual blogs - weekly blogs - wingman blogs - word blogs - words blogs - writer blogs - poetry blogs - prescription blogs - sagittarius blogs - straight blogs - summer blogs - gi blogs - hooka blogs - penis enlargement blogs - vfw blogs - casinos blogs - casino blogs - web hosting blogs - hosting blogs - auto blogs - truck blogs - van blogs - suv blogs - 4 wheel blogs - harley blogs - flu blogs - diet blogs - pistols blogs - teenage blogs - lpga blogs - burnable blogs - new tunes blogs - coaching blogs - treasures blogs - trades blogs - nutty blogs - skate blogs - play 21 blogs - weather blogs - poker players - golf blogs - american blogs - football blogs - baseball blogs - hockey blogs - basketball blogs - soccer blogs - cooking blogs - recipe blogs - space blogs - 3d games blogs - barbecue blogs




the delimited archives:

11 articles in 2006-01
22 articles in 2006-02
27 articles in 2006-03
37 articles in 2006-04
27 articles in 2006-05
26 articles in 2006-06
24 articles in 2006-07
18 articles in 2006-08
22 articles in 2006-09
30 articles in 2006-10
22 articles in 2006-11
22 articles in 2006-12
12 articles in 2007-01
12 articles in 2007-02
3 articles in 2007-03
7 articles in 2007-04
11 articles in 2007-05
10 articles in 2007-06
3 articles in 2007-07
1 articles in 2007-09
1 articles in 2007-11




next page


delimited