Data Mining

Data Mining?

New postby Mina » 22 Oct 2012, 16:21

One disadvantage of data mining is that it:
A. accumulates so much data that it is difficult to use efficiently.
B. bypasses virus checking.
C. produces graphs and reports, no straight-forward data.
D. generates few results
Mina
 
Posts: 1359
Joined: 08 Apr 2009, 18:45

New postby Rosalie » 22 Oct 2012, 16:21

A...btw this is NOT an Earth Sciences and Geology questions, despite the fact that the word "mining" is in it.
Rosalie
 
Posts: 1422
Joined: 08 Apr 2009, 18:45

How to do data mining with cron jobs?

New postby Alaine » 22 Oct 2012, 16:21

I have to fetch data from websites to my database. How could I do that? Thanks.
Alaine
 
Posts: 1399
Joined: 08 Apr 2009, 18:45

New postby Darcey » 22 Oct 2012, 16:21

You can get an xml file from your website and integrate it into your db using a conversion tool.
Darcey
 
Posts: 1375
Joined: 08 Apr 2009, 18:45

What is Data Mining and do I land a job in such a field?

New postby Alicia » 22 Oct 2012, 16:21

I do have some programming experience in SQL Server and my college degree is in Business Administration. I do have some programming experience in SQL Server and my college degree is in Business Administration.
Alicia
 
Posts: 1405
Joined: 08 Apr 2009, 18:45

New postby Sunni » 22 Oct 2012, 16:21

Data mining is using the internet for super powerful searches. The searches try to contain data and use data for research on international terror orginizations and many other uses. Other data include financial transactions between swiss bank acounts for the financial gain of insurgents in Afghanistan and Iraq. Money always leaves a digital trail that can be accessed through ip addresses, place of origion and time of transaction. Data also on the outher hand can be encriypted using high level intel pentium chips but i would need to learn the details of computer programing; I know the framework of how it conceptually works.
Sunni
 
Posts: 1348
Joined: 08 Apr 2009, 18:45

How do I start out if I want to have a career in Data...

New postby Gordon » 22 Oct 2012, 16:21

How do I start out if I want to have a career in Data Mining?

I have a Bachelor of Science Degree in Business Administration.
Gordon
 
Posts: 1358
Joined: 08 Apr 2009, 18:45

New postby Everette » 22 Oct 2012, 16:21

Take as much statistics as you can stomach, particularly in regression and linear models.

Some facility with computer software particularly (a) one of the primary stat or business intelligence analytics packages like SAS, and (b) some SQL or other database-related experience would be useful.

I'll assume your degree gave you enough understanding of financials and business principles.

P.S. There are now a few Master's programs with data mining concentrations, you could either think about one of those, or find a entry-level job associated with data mining to give yourself some real-world experience first. If not strictly a data mining job, then certain financial or business analyst positions would provide you some exposure.
Everette
 
Posts: 1402
Joined: 08 Apr 2009, 18:45

What is your view on the Patriot Act and wiretapping and...

New postby Stepanie » 22 Oct 2012, 16:21

What is your view on the Patriot Act and wiretapping and data mining?

Here is my view:

The right of the people to be secure in their persons, houses, papers, and effects, against unreasonable searches and seizures, shall not be violated, and no Warrants shall issue, but upon probable cause, supported by Oath or affirmation, and particularly describing the place to be searched, and the persons or things to be seized.
Stepanie
 
Posts: 1369
Joined: 08 Apr 2009, 18:45

New postby Jalisa » 22 Oct 2012, 16:21

I think it was named inappropriately, it should have been named; the Un-Patriotic Act. As any “law” passed that supersedes the rights of the people as set fourth by the founding fathers of this great nation is “Un-Patriotic”
Jalisa
 
Posts: 1451
Joined: 08 Apr 2009, 18:45

What's the difference between Data mining and Machine...

New postby Ethan » 22 Oct 2012, 16:21

What's the difference between Data mining and Machine learning?

Can somebody explain with example plz?
Ethan
 
Posts: 1371
Joined: 08 Apr 2009, 18:45

New postby Alaine » 22 Oct 2012, 16:22

As a broad subfield of artificial intelligence, machine learning is concerned with the design and development of algorithms and techniques that allow computers to "learn". At a general level, there are two types of learning: inductive, and deductive. Inductive machine learning methods extract rules and patterns out of massive data sets.

The major focus of machine learning research is to extract information from data automatically, by computational and statistical methods. Hence, machine learning is closely related not only to data mining and statistics , but also theoretical computer science.

Data mining relies on the use of real world data. This data is extremely vulnerable to co-linearity precisely because data from the real world may have unknown interrelations. An unavoidable weakness of data mining is that the critical data that may explain the relationships is never observed. Alternative approaches using an experiment based approach such as Choice Modelling for human generated data may be used. Inherent correlations are either controlled for or removed altogether through the construction of an experimental design.

Data mining has been cited as the method by which the U.S. Army unit Able Danger supposedly had identified the September 11, 2001 attacks leader, Mohamed Atta, and three other 9/11 hijackers as possible members of an al Qaeda cell operating in the U.S. more than a year before the attack.
Alaine
 
Posts: 1399
Joined: 08 Apr 2009, 18:45

What is the legal reason for data mining domestic phone...

New postby Christel » 22 Oct 2012, 16:22

What is the legal reason for data mining domestic phone calls?

This intrusive investigation does not make Americans any safer - going in and reading emails, listening on phone conversations and opening mail is none of the government's business. This rubber stamp Republican Congess won't protect our rights or protect us abroad with our " go it alone " policy on world terror. This comes out of the White House. Another reason the Chimp is at 29%
Christel
 
Posts: 1417
Joined: 08 Apr 2009, 18:45

New postby Cory » 22 Oct 2012, 16:22

Legally speaking, it is a brilliant strategy! Obviously, any self-respecting al-Qaeda operative (is that an oxymoron?) will plan everything in graphic detail on ordinary, everyday domestic telephone lines. This is exactly how we foiled those vicious bastards on 9/11, remember? We were all over that plan... erm... no, wait. Well, if our dictator-for-life wants it, it just has to be good for us, right? I mean, that's what life under an ultra right-wing neo-fascist regime is all about, isn't it? Welcome to America! Love it or leave it!

(God, did I just say that? Even in a satirical context that felt dirty... I'll go have a thorough wash, lol...)
Cory
 
Posts: 1329
Joined: 08 Apr 2009, 18:45

What does this statistics/data mining jargon mean?

New postby Twyla » 22 Oct 2012, 16:22

"Binning"

Ex: field filtering, naming, recategorising, "binning"

Can you explain me in layman's terms what it means? Appreciate if you could give an example or a website.
Twyla
 
Posts: 1354
Joined: 08 Apr 2009, 18:45

New postby Dorinda » 22 Oct 2012, 16:22

"Binning" in English simply means to place in a bin or container.

A slightly more restricted meaning is that of sorting into a set of "containers". In data processing you can see that it would mean identifying data types according to some classification scheme and sorting the data according to some groupings within the selected schemes. Data can be accumulated in registers or files (the "bins".)

An even narrower meaning is found in image processing whereby image data from a group of pixels is used to reduce signal noise. There are good descriptions of why and how this is done in the two URLs below. Presumably this technique can be used for other kinds of noise-containing data sets. I did not pursue that inquiry since I could not immediately find my information theory textbook.

I hope this was of some help





http://www.noao.edu/outreach/aop/glossary/binning.html
http://www.ccd.com/ccd103.html
Dorinda
 
Posts: 1424
Joined: 08 Apr 2009, 18:45

Next

  • Similar topics
    Replies
    Views
    Last post

Return to Earth Sciences & Geology



Who is online

Users browsing this forum: No registered users and 1 guest