要打印的每一封电子邮件MAXM入门反对另一列(Want to print maxm entry of

我身边有2 GB有更多然后20​​00万行的一个巨大的文件

我想是

输入文件会是这样

[e-mail],1
[e-mail],1
[e-mail],1
[e-mail],2
[e-mail],3
[e-mail],4
[e-mail],5
[e-mail],6
[e-mail],7
[e-mail],1
[e-mail],1
[e-mail],1
[e-mail],2
[e-mail],3
[e-mail],1
[e-mail],2
[e-mail],1
[e-mail],1
[e-mail],2
[e-mail],3
[e-mail],1
[e-mail],1
[e-mail],2
[e-mail],3
[e-mail],1
[e-mail],2
[e-mail],1
[e-mail],1
[e-mail],1
[e-mail],1,1
[e-mail],2
[e-mail],3
[e-mail],4
[e-mail],5
[e-mail],6
[e-mail],7
[e-mail],1
[e-mail],2
[e-mail],3
[e-mail],4

输出文件所需： -

[e-mail],1,1
[e-mail],1,1
[e-mail],1,7
[e-mail],2,7
[e-mail],3,7
[e-mail],4,7
[e-mail],5,7
[e-mail],6,7
[e-mail],7,7
[e-mail],1,1
[e-mail],1,1
[e-mail],1,3
[e-mail],2,3
[e-mail],3,3
[e-mail],1,2
[e-mail],2,2
[e-mail],1,1
[e-mail],1,3
[e-mail],2,3
[e-mail],3,3
[e-mail],1,1
[e-mail],1,3
[e-mail],2,3
[e-mail],3,3
[e-mail],1,2
[e-mail],2,2
[e-mail],1,1
[e-mail],1,1
[e-mail],1,1
[e-mail],1,7
[e-mail],2,7
[e-mail],3,7
[e-mail],4,7
[e-mail],5,7
[e-mail],6,7
[e-mail],7,7
[e-mail],1,4
[e-mail],2,4
[e-mail],3,4
[e-mail],4,4

I，E 1更包含对应于在各列中的特定电子邮件，使得每一行现在包含每封电子邮件的最大occurence条目的最大无柱。 我寻找一个可行SOLN这样的大型文件优选在Python或外壳脚本和O（n）的复杂性或O（nlogn）为O（n ** 2）不会做在这种情况下

Answer 1:

让我们试着Python脚本，因为你可能会更熟悉的语言，不需要巨大的内存或硬盘空间。 测试在Python 2.7版和3.2

#!/usr/bin/python
email = "" # Initialize the email
count = 0  # and counter
import fileinput

for line in fileinput.input("word.txt"): # Interator: process a line at a time
  myArr = line.split(",")
  if (email != myArr[0]): # New email; print and reset count, email
    for n in range(0,count):
      print email + "," + str(n+1) + "," + str(count)
    email = myArr[0]
    count = 1  
  else: # Same email, increment count
    count = count + 1

# Print the final email
for n in range(0,count):
  print email + "," + str(n+1) + "," + str(count)

任何人想尝试一下awk脚本？

Answer 2:

我知道你想有一个包含每个邮件的第二列的maximun值的第三列。

我的话，我会用一个图来存储找到为每个邮件的maximun第二列的值：

伪代码：

1. 创建一个空的地图，邮件串钥匙在设置 - > MS
2. 用于输入文件的每行（1）：
   1. 如果（l.mail不在M）OR（在M和l.secondColumn l.mail> M [l.mail] .secondColumn）然后：l.thirdColumn = l.secondColunn AND M [l.mail] = 1;
3. 创建一个新的文件 - > FOUT
4. 遍历（每个地图项）的映射条目：
   1. 追加M [进入]到FOUT。

文章来源: Want to print maxm entry of every email against it in another column