Notifications
Clear all

What is “speculative execution” in Hadoop?

RSS

(@abhijith)
Noble Member
加入ed: 2 years ago
帖子:1350
17/03/2021 11:25 am
What is the meaning of 'speculative execution' in Hadoop?

Quote
(@ganesh)
Noble Member
加入ed: 2 years ago
Posts: 1362
17/03/2021 11:27 am

In Hadoop, the term "speculative execution" is used when a node is assigned a task and the node appears to be executing the task slower than expected, in which case, the master node assigns another instance of the same task to another executor node. Now, whichever node executes the task first, the output is taken from that node and the concurrent task being executed on the pending node is terminated or killed.


ReplyQuote
Share:
Baidu