Home > Terms > English (EN) > MapReduce

MapReduce

MapReduce is an algorithm design pattern that originated in the functional programming world. In this design, a mapper function or script scans the input data and outputs a series of keys and values to use in calculating the results. The keys are used to cluster together bits of data that will be needed to calculate a single output result. The unordered list of keys and values is then put through a sort step that ensures that all the fragments that have the same key are next to one another in the file. The reducer stage then goes through the sorted output and receives all of the values that have the same key in a contiguous block.

Although it may seems a roundabout way of processing the data, its prime advantage is that it removes unplanned random accesses, with all scattering and gathering handled in the sorting phase. Even on single machines, this boosts performance, thanks to the increased locality of memory accesses, but it also allows the process to be split across a large number of machines easily, by dealing with the input in many independent chunks and partitioning the data based on the key.

Hadoop is the best-known public system for running MapReduce algorithms, but many modern databases, such as MongoDB, also support it as an option.

0
  • Part of Speech: proper noun
  • Synonym(s):
  • Blossary:
  • Industry/Domain: Internet
  • Category: Big data
  • Company:
  • Product:
  • Acronym-Abbreviation:
Collect to Blossary

Member comments

You have to log in to post to discussions.

Terms in the News

Billy Morgan

Sports; Snowboarding

British snowboarder Billy Morgan has landed the sport’s first ever 1800 quadruple cork. The rider, who represented Great Britain at the 2014 Winter Olympics in Sochi, was in Livigno, Italy, when he achieved the manoeuvre. It involves flipping four times, while the body also spins five complete rotations on a sideways or downward-facing axis. The trick had ...

Marzieh Afkham

Broadcasting & receiving; News

Marzieh Afkham, who is the country’s first foreign ministry spokeswoman, will head a mission in east Asia, the state news agency reported. It is not clear to which country she will be posted as her appointment has yet to be announced officially. Afkham will only be the second female ambassador Iran has had. Under the last shah’s rule, Mehrangiz Dolatshahi, a ...

Weekly Packet

Language; Online services; Slang; Internet

Weekly Packet or "Paquete Semanal" as it is known in Cuba is a term used by Cubans to describe the information that is gathered from the internet outside of Cuba and saved onto hard drives to be transported into Cuba itself. Weekly Packets are then sold to Cuban's without internet access, allowing them to obtain information just days - and sometimes hours - after it ...

Asian Infrastructure Investment Bank (AIIB)

Banking; Investment banking

The Asian Infrastructure Investment Bank (AIIB) is an international financial institution established to address the need in Asia for infrastructure development. According to the Asian Development Bank, Asia needs $800 billion each year for roads, ports, power plants or other infrastructure projects before 2020. Originally proposed by China in 2013, a signing ...

Spartan

Online services; Internet

Spartan is the codename given to the new Microsoft Windows 10 browser that will replace Microsoft Windows Internet Explorer. The new browser will be built from the ground up and disregard any code from the IE platform. It has a new rendering engine that is built to be compatible with how the web is written today. The name Spartan is named after the ...

Featured Terms

Tseupage
  • 2

    Terms

  • 0

    Blossaries

  • 2

    Followers

Industry/Domain: Animals Category: Dogs

Pit Bull

A Pit Bull is a medium-sized, solidly built, short haired dog characterized with a large, broad head. Known for their intelligence and loyalty, a Pit ...

Contributor

Contributors in Internet

Featured blossaries

payment in foreign trade

Category: Business   1 4 Terms

East African Cuisine

Category: Food   1 15 Terms