Subscribe to our Newsletter

May 2016 Blog Posts (4)

7 Tools to extract text from HTML document

I want to share an interesting article about data scaping that you might need in your business. The article below is mainly reprinted from here

Text in the HTML document is the content that placed between HTML tags like <a> </a> , <title> </title>. Sometimes we want to extract the text in the HTML document and there are two methods that can…

Continue

Added by Nora Choi on May 31, 2016 at 2:30am — No Comments

Hadoop Yarn explanation and container memory allocations

Yarn Resource manager (The Yarn service Master component)

1) Controls of the total resource capacity of the cluster

2) Whatever the container is needed in the cluster it sets the minimum container size that is controlled by yarn configuration property

àyarn.scheduler.minimum-allocation-mb 1024(This value changes based on cluster ram capacity)

Description: The minimum allocation for every container request at the RM, in MBs.…

Continue

Added by skumar T on May 30, 2016 at 8:00pm — No Comments

Data has always existed, the key is the right data

What does The Library of Alexandria, The Normans and a book have to do with data? I never thought about

The Library...

...at Alexandria was in charge of collecting all the world's knowledge, and most of the staff was occupied with the task of translating works onto papyrus paper... 1

Or The Normans and the...

Domesday Book (Latin: Liber de Wintonia "Book of…

Continue

Added by George Psistakis on May 20, 2016 at 5:20am — No Comments

Which Language is Better For Writing a Web Crawler? PHP, Python or Node.js?

I want to share with you a good article that might help you better extract web data for your business.

Yesterday, I saw someone asking “which programming language is better for writing a web crawler? PHP, Python or Node.js?”and mentioning some requirements as below.

 

  1. The analytic ability to web page
  2. Operational capability to database(MySQL)
  3. Efficiency of crawling
  4. The…
Continue

Added by Nora Choi on May 19, 2016 at 6:30pm — 3 Comments

Blog Topics by Tags

Monthly Archives

2019

2018

2017

2016

2015

2014

2013

On Data Science Central

© 2019   BigDataNews.com is a subsidiary of DataScienceCentral LLC and not affiliated with Systap   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service