Subscribe to our Newsletter

All Blog Posts (228)

The Largest Number Ever Created

There are numbers that are so large that there is no compact formula to represent them. Think of a number so large, that its number of digits is so large, that the number of digits of its number of digits is so large... and it goes on and on -- you get the idea.

Sure, if you are able to define such a number, then add one, or even 0.5, and you get an even bigger number. But this is not the point. The issue is to come up with such massive numbers in the first place. The biggest…

Continue

Added by Vincent Granville on August 16, 2017 at 1:00pm — No Comments

25 Big Data Terms You Must Know To Impress Your Date (Or whoever you want to)

Guest blog post by Ramesh Dontha

Big Data can be intimidating! If you are new to Big Data, please read ‘…

Continue

Added by Andrei Macsin on July 11, 2017 at 10:07am — No Comments

12 Great Articles from Big Data News

Big Data News is one of Data Science Central channels. Below is a selection of popular articles published a while back:

Continue

Added by Vincent Granville on June 8, 2017 at 7:00pm — No Comments

5 Big Data Predictions for 2017

Data increasingly turns into one of the fiercest means of businesses, which means that companies are now competing by restructuring their operations, updating the systems and looking for the best solutions for integration and analysis. What does this mean for the future of data?

Effective data managing is now the central role and a huge opportunity to move past the competition. With all this in mind, we are presenting 5 big data predictions for 2017.

1.     Cloud…

Continue

Added by Laura Buckler on April 18, 2017 at 5:09am — No Comments

Is Hadoop Failing?

'Hadoop Is Failing' Article

A recent LinkedIn post linking to an Innovation Enterprise article entitled 'Hadoop Is Failing' certainly got our attention, as you might expect.

Apart from disagreeing with the assertion that 'Hadoop...is very much the foundation on which data today is built' the main thrust of the article…

Continue

Added by Richard Jackson on April 14, 2017 at 12:30am — No Comments

Advanced Analytics Give CFOs More Clout

Advanced analytics continues to permeate more functional areas of the enterprise.  From marketing campaigns and sales optimization to supply chain and human capital management, business users are deploying newer, easier to use…

Continue

Added by Gabriel Lowy on April 11, 2017 at 8:00am — No Comments

Web Scraping Service & OVR Classification based on Twitter in Machine Learning

     

 

Many social media, like Twitter, Facebook and etc, are evolving to become a source of information for people to scrape varied kinds of data, since microblogs on which users post real time messages shows millions of opinions about their attitudes or sentiment towards hot topics and current issues. Recently, I decided to learn how Regional sentiment analysis can help people to make specific decisions or policy…

Continue

Added by Paul Black on March 20, 2017 at 2:30am — No Comments

Website Crawler & Sentiment Analysis

            

 

To start with Sentiment Analysis, what comes first to our mind is where and how we can crawl oceans of data for our analysis. Normally, web crawler or crawling from web social media should be one reasonable way to get access to the public opinion data resource. Thus, in this writing, I want to share with you about how I crawled the website using web crawler and proceeded to deal with those data for…

Continue

Added by Paul Black on February 28, 2017 at 10:00pm — No Comments

The Best Answers to Your Most Crucial Deep Learning Questions

(picture from www.re-work.co)

Most people keep close eyes on the top of the fast-moving technology trends. There’s no doubt that deep learning is most trending buzzwords today. Deep learning has made a significant breakthrough and is applied in many areas like facial recognition, recognizing images and AlphaGo Games. Thus…

Continue

Added by Paul Black on December 14, 2016 at 11:30pm — No Comments

How to Collect Big Data

Yes we know that you will be having a lots of queries such as Collection of Big Data, How organizations gather Big Data, how to gather information for quantitative research so don't stress, in the event that you are here to hunt down these questions here then you are on the right page as here we are going to give you a complete article on Collection of Big Data strategies quickly. …

Continue

Added by Ayushi Mishra on November 4, 2016 at 3:00am — No Comments

Two Fastest Ways for Startups to Build Your Email Database

Before you start email marketing, you need a huge email list for that. Email Marketing is all about growing your email list. Plus email addresses are extremely valuable. The more addresses you get, and the better their quality they are, the more successful you will be as an online marketer. I know it sounds crazy to collect 100,000 emails in 1 day. But it’s possible. Here are two fastest ways for startups to grow your email list.

 

1. Google…

Continue

Added by Paul Black on November 2, 2016 at 7:00pm — No Comments

IoT Continues to Makeover Many Industries; Adoption of IoT to Increase in Emerging Nations: Internet of Things Market:

Over the past few years, the Internet of Things has given all physical things, a complete digital makeover. Today, a wide variety of things are being computerized and linked to networks, ranging from cars, watches, appliances, and clothes. Even farm fields and roadways are being upgraded and modified with digital sensors. This optimistic outlook has helped many companies and industries to redesign their operations.

Vodafone, recently signed a deal with Inmarsat, to use their satellite…

Continue

Added by Pragati P. on October 24, 2016 at 4:00am — No Comments

Top 30 Free Web Scraping Software

Web scraping (also termed web data extraction, screen scraping, or web harvesting) is a web technique of extracting data from the web, and turning unstructured data on the web  into structured data that can stored to your local computer or a database.

The web scraping technique is implemented by web scraping software tools. These tools interacts with websites in the same way as you do when using a…

Continue

Added by Paul Black on September 22, 2016 at 11:00pm — No Comments

Smart Business: automated sentiments analysis on top

The modern world seems really fast and dynamic with a multitude of new products being launched. Marketing agencies are making fortune by monitoring the markets and delivering reports on consumers’ opinions. For today, the feedback analysis is a separate area, let’s say a growing industry with an array of products and services. And the prices for those services are pretty exorbitant.

So, do vendors have a chance to cut down…

Continue

Added by Yana Yelina on August 12, 2016 at 12:00am — No Comments

Can Science Create a System to Win at Roulette?

Probability and physics are helping make even roulette seem ultimately predictable.

In his new book, The Perfect Bet: How Science and Math Are Taking the Luck Out of Gambling, Adam Kucharski details how trying to understand dice games led one mathematician to develop probability theory,…

Continue

Added by Edward Turner on July 19, 2016 at 4:30pm — No Comments

Data Wars: Dawn of the Yottabyte

Big Data is an accumulation of data that is too large and complex for processing by traditional database management tools.

-Merriam Webster

 

Yeah But, What Really Makes Big Data Big Data?  This question is as fundamental to data science as the chicken/egg question should be to researchers at KFC. But we’re not dealing with an A/B chicken model here.  It’s more elephant to the dark room or scaling it up, the nearest star to our galactic…

Continue

Added by Orion Stallard on July 8, 2016 at 12:54pm — No Comments

7 Tools to extract text from HTML document

I want to share an interesting article about data scaping that you might need in your business. The article below is mainly reprinted from here

Text in the HTML document is the content that placed between HTML tags like <a> </a> , <title> </title>. Sometimes we want to extract the text in the HTML document and there are two methods that can…

Continue

Added by Nora Choi on May 31, 2016 at 2:30am — No Comments

Hadoop Yarn explanation and container memory allocations

Yarn Resource manager (The Yarn service Master component)

1) Controls of the total resource capacity of the cluster

2) Whatever the container is needed in the cluster it sets the minimum container size that is controlled by yarn configuration property

àyarn.scheduler.minimum-allocation-mb 1024(This value changes based on cluster ram capacity)

Description: The minimum allocation for every container request at the RM, in MBs.…

Continue

Added by skumar T on May 30, 2016 at 8:00pm — No Comments

Data has always existed, the key is the right data

What does The Library of Alexandria, The Normans and a book have to do with data? I never thought about

The Library...

...at Alexandria was in charge of collecting all the world's knowledge, and most of the staff was occupied with the task of translating works onto papyrus paper... 1

Or The Normans and the...

Domesday Book (Latin: Liber de Wintonia "Book of…

Continue

Added by George Psistakis on May 20, 2016 at 5:20am — No Comments

Which Language is Better For Writing a Web Crawler? PHP, Python or Node.js?

I want to share with you a good article that might help you better extract web data for your business.

Yesterday, I saw someone asking “which programming language is better for writing a web crawler? PHP, Python or Node.js?”and mentioning some requirements as below.

 

  1. The analytic ability to web page
  2. Operational capability to database(MySQL)
  3. Efficiency of crawling
  4. The…
Continue

Added by Nora Choi on May 19, 2016 at 6:30pm — 3 Comments

Monthly Archives

2017

2016

2015

2014

2013

© 2017   BigDataNews.com is a subsidiary of DataScienceCentral LLC and not affiliated with Systap   Powered by

Badges  |  Report an Issue  |  Terms of Service